00000001:02000400:3.0F:1782727156.179638:0:3094:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg260-server.virtnet: executing set_hostid 00000001:02000400:3.0:1782727179.874864:0:3318:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg260-server.virtnet: executing load_modules_local 00000001:01000000:0.0F:1782727181.996671:0:3382:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 915 MB/s 00000001:01000000:0.0:1782727182.246421:0:3382:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 831 MB/s 00000001:01000000:2.0F:1782727182.495941:0:3382:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4007 MB/s 00000020:02000000:1.0F:1782727183.619724:0:3411:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.54_83_gbddb8b7 00000400:02000000:2.0:1782727184.558093:0:3426:0:(api-ni.c:2752:lnet_startup_lndni()) Added LNI 192.168.202.160@tcp [8/256/0/180] 00008000:02000000:2.0:1782727188.440308:0:3576:0:(echo_client.c:2573:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0:1782727235.447837:0:5177:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg260-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1782727249.163873:0:5926:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:2.0:1782727249.163880:0:5926:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1782727249.163916:0:5926:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1782727249.164050:0:5926:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 00000000b6cd3216 00000080:02000400:2.0:1782727249.164061:0:5926:0:(super25.c:154:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1782727249.179237:0:5926:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1782727249.179250:0:5926:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1782727249.179346:0:5926:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000afe2fddc) 00000020:00000080:2.0:1782727249.179364:0:5926:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1782727249.274720:0:5926:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1782727249.274802:0:5926:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:2.0:1782727249.293719:0:5926:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1782727249.294396:0:5926:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1782727249.294404:0:5926:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1782727249.294417:0:5926:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x14a47870ee88c8a9 00000020:01000004:3.0:1782727249.294424:0:5926:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1782727249.294428:0:5926:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1782727249.294433:0:5926:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000b6cd3216 from MGS 00000020:01000004:3.0:1782727249.294438:0:5926:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1782727249.294460:0:5926:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000005162dd7e) 00000020:00000080:3.0:1782727249.294473:0:5926:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1782727249.294662:0:5926:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000b6cd3216 from MGS, refs=2 00080000:01000000:3.0:1782727249.294667:0:5926:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:3.0:1782727249.294672:0:5926:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x14a47870ee88c8b7 00000100:00100000:3.0:1782727249.294761:0:5926:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1782727249.294860:0:5926:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1782727249.294866:0:5926:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1782727249.295736:0:5926:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1782727249.295743:0:5926:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1782727249.296816:0:5926:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782727249.297490:0:5926:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1782727249.297497:0:5926:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1782727249.298814:0:5926:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1782727249.298824:0:5926:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1782727249.299500:0:5926:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1782727249.299507:0:5926:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1782727249.300617:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727249.300621:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727249.300622:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727249.300863:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727249.300865:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727249.300866:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727249.301705:0:5926:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1782727249.310150:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:1.0:1782727249.551100:0:5926:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3143 MB/s 00000001:01000000:1.0:1782727249.801027:0:5926:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 4103 MB/s 00000001:01000000:3.0:1782727250.051732:0:5926:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 1047 MB/s 00000001:01000000:3.0:1782727250.301389:0:5926:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 1235 MB/s 00080000:10000000:3.0:1782727250.305835:0:5926:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:2.0:1782727250.316281:0:5926:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1782727250.317983:0:5940:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1782727250.321745:0:5926:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1782727250.321795:0:5926:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1782727250.322025:0:5926:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1782727250.322062:0:5926:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1782727250.322550:0:5926:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782727250.322708:0:5926:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1782727250.322713:0:5926:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1782727250.327038:0:5926:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1782727250.327120:0:5926:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1782727250.327568:0:5926:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1782727250.327575:0:5926:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1782727250.330750:0:5926:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1782727250.330774:0:5926:0:(obd_mount.c:402:lustre_start_mgc()) Start MGC 'MGC192.168.202.160@tcp' 00000020:01000004:1.0:1782727250.330776:0:5926:0:(obd_mount.c:411:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1782727250.330868:0:5926:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGC192.168.202.160@tcp (typ=mgc) 00000020:00000080:1.0:1782727250.330942:0:5926:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.160@tcp (00000000e11226fc) 00000020:00000080:1.0:1782727250.330959:0:5926:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1782727250.331091:0:5926:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000ecf25596@MGC192.168.202.160@tcp: add connection 192.168.202.160@tcp at head 00010000:00010000:1.0:1782727250.331232:0:5926:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.160@tcp-0 is initialized 00000040:01000000:1.0:1782727250.331238:0:5926:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.160@tcp ctxt 1 is initialized 00000100:00080000:2.0:1782727250.331661:0:5945:0:(pinger.c:468:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1782727250.333252:0:5946:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1782727250.333328:0:5926:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.160@tcp (uuid c71e9f0f-6441-4b9b-bc96-153ab9250801) 00000020:00000080:1.0:1782727250.333348:0:5926:0:(genops.c:1406:class_connect()) connect: client c71e9f0f-6441-4b9b-bc96-153ab9250801, cookie 0x14a47870ee88c8c5 00000100:00080000:1.0:1782727250.333368:0:5926:0:(import.c:512:import_select_connection()) MGC192.168.202.160@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782727250.333374:0:5926:0:(import.c:626:import_select_connection()) MGC192.168.202.160@tcp: import 00000000ecf25596 using connection 192.168.202.160@tcp/0@lo 00000100:00100000:1.0:1782727250.333419:0:5926:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000001f5b26c6 x1869324939690112/t0(0) o250->MGC192.168.202.160@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1782727250.333449:0:5926:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import c71e9f0f-6441-4b9b-bc96-153ab9250801->MGS 00000020:01000004:1.0:1782727250.333469:0:5926:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1782727250.333474:0:5926:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1782727250.333486:0:5926:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000003304303f) 00000020:00000080:1.0:1782727250.333499:0:5926:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1782727250.334316:0:3441:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001f5b26c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c71e9f0f-6441-4b9b-bc96-153ab9250801:3441:1869324939690112:0@lo:250: 00000100:00100000:2.0:1782727250.334416:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727250.334496:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939690112 00000100:00100000:2.0:1782727250.334502:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939690112 00000100:00100000:2.0:1782727250.334526:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782727250.334531:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ec19e05f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3441:x1869324939690112:12345-0@lo:250: 00010000:00080000:2.0:1782727250.334551:0:5942:0:(ldlm_lib.c:1434:target_handle_connect()) MGS: connection from c71e9f0f-6441-4b9b-bc96-153ab9250801@0@lo t0 exp 0000000000000000 cur 145 last 0 00000020:00000080:2.0:1782727250.334576:0:5942:0:(genops.c:1406:class_connect()) connect: client c71e9f0f-6441-4b9b-bc96-153ab9250801, cookie 0x14a47870ee88c8d3 00000100:00080000:2.0:1782727250.334704:0:5942:0:(import.c:65:import_set_state_nolock()) 0000000046656c0f : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782727250.334748:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ec19e05f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+5:3441:x1869324939690112:12345-0@lo:250: Request processed in 216us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727250.334756:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782727250.334798:0:3441:0:(client.c:3111:ptlrpc_free_committed()) MGC192.168.202.160@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1782727250.334806:0:3441:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.202.160@tcp: connect to target with instance 0 00000100:00080000:2.0:1782727250.334812:0:3441:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.202.160@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1782727250.334817:0:3441:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1782727250.334819:0:3441:0:(import.c:65:import_set_state_nolock()) 00000000ecf25596 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1782727250.334822:0:3441:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1782727250.334828:0:3441:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1782727250.334833:0:3441:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001f5b26c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c71e9f0f-6441-4b9b-bc96-153ab9250801:3441:1869324939690112:0@lo:250: 00000100:00100000:1.0:1782727250.345624:0:5926:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782727250.345802:0:5926:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1782727250.345808:0:5926:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1782727250.347025:0:5926:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1782727250.347033:0:5926:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1782727250.347474:0:5926:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1782727250.347482:0:5926:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1782727250.348241:0:5926:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782727250.348401:0:5926:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1782727250.348406:0:5926:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1782727250.358410:0:5926:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1782727250.358424:0:5926:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00010000:00010000:3.0:1782727250.365032:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727250.393416:0:5926:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782727250.393677:0:5926:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1782727250.393685:0:5926:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1782727250.394871:0:5926:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1782727250.395026:0:5926:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1782727250.395744:0:5926:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782727250.396014:0:5926:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1782727250.396020:0:5926:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1782727250.396521:0:5926:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1782727250.396527:0:5926:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1782727250.397313:0:5926:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782727250.397453:0:5926:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1782727250.397458:0:5926:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1782727250.409333:0:5926:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1782727250.409352:0:5926:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1782727250.410026:0:5926:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782727250.410204:0:5926:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1782727250.410210:0:5926:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1782727250.410689:0:5926:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1782727250.410696:0:5926:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1782727250.441040:0:5926:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782727250.441227:0:5926:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1782727250.441234:0:5926:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1782727250.442407:0:5926:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1782727250.442416:0:5926:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1782727250.443195:0:5926:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1782727250.443203:0:5926:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1782727250.444050:0:5926:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1782727250.444078:0:5926:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1782727250.444084:0:5926:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.160@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1782727250.444186:0:5926:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.160@tcp ctxt 0 is initialized 00000020:01000004:1.0:1782727250.444225:0:5926:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.160@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1782727250.444230:0:5926:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1782727250.444232:0:5926:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1782727250.444233:0:5926:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782727250.444234:0:5926:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782727250.444235:0:5926:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782727250.444237:0:5926:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782727250.444238:0:5926:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1782727250.444239:0:5926:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1782727250.444240:0:5926:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1782727250.444241:0:5926:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1782727250.444243:0:5926:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782727250.444244:0:5926:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1782727250.444247:0:5926:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1782727250.444248:0:5926:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1782727250.444250:0:5926:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1782727250.444251:0:5926:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782727250.444251:0:5926:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782727250.444252:0:5926:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782727250.444253:0:5926:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782727250.444254:0:5926:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1782727250.444256:0:5926:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1782727250.444257:0:5926:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1782727250.444262:0:5926:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1782727250.444263:0:5926:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782727250.444264:0:5926:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1782727250.444289:0:5926:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1782727250.444305:0:5926:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000003c90e6a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:5926:1869324939690240:0@lo:253: 00000100:00100000:1.0:1782727250.444381:0:5926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727250.444495:0:5926:0:(client.c:2701:ptlrpc_set_wait()) set 0000000053acfc65 going to sleep for 11 seconds 00000100:00100000:2.0:1782727250.444533:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939690240 00000100:00100000:2.0:1782727250.444539:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939690240 00000100:00100000:2.0:1782727250.444590:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782727250.444608:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008c8af633 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+5:5926:x1869324939690240:12345-0@lo:253: 20000000:01000000:2.0:1782727250.444654:0:5944:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1782727250.444656:0:5944:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1782727250.445088:0:5965:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1782727250.445128:0:5944:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1782727250.445389:0:5944:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782727250.446204:0:5966:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1782727250.446388:0:5944:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1782727250.446391:0:5944:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1782727250.446396:0:5944:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1782727250.446399:0:5944:0:(mgs_llog.c:3603:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1782727250.446409:0:5944:0:(mgs_llog.c:3163:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1782727250.446510:0:5944:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782727250.446629:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1782727250.446641:0:5944:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1782727250.446658:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1782727250.446672:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1782727250.446684:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1782727250.446730:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1782727250.446738:0:5944:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1782727250.446751:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1782727250.446756:0:5944:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1782727250.446770:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1782727250.446774:0:5944:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1782727250.446783:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1782727250.446797:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1782727250.446820:0:5944:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1782727250.446825:0:5944:0:(mgs_llog.c:3163:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1782727250.446831:0:5944:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782727250.447157:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1782727250.447171:0:5944:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1782727250.447201:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1782727250.447221:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1782727250.447236:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1782727250.447245:0:5944:0:(mgs_llog.c:3120:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1782727250.447274:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1782727250.447282:0:5944:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1782727250.447295:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1782727250.447320:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1782727250.447335:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1782727250.447343:0:5944:0:(mgs_llog.c:3085:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1782727250.447368:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1782727250.447375:0:5944:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1782727250.447386:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1782727250.447401:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1782727250.447451:0:5944:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1782727250.447469:0:5944:0:(mgs_llog.c:3300:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1782727250.447475:0:5944:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1782727250.447791:0:5967:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1782727250.448108:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1782727250.448125:0:5944:0:(mgs_llog.c:3346:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.160@tcp for mdt 20000000:01000000:0.0:1782727250.448127:0:5944:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.202.160@tcp (null) (null) (null) 00000040:00080000:0.0:1782727250.448142:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1782727250.448147:0:5944:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1782727250.448158:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1782727250.448164:0:5944:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.160@tcp (null) (null) 00000040:00080000:0.0:1782727250.448176:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1782727250.448182:0:5944:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1782727250.448195:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1782727250.448210:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1782727250.448236:0:5944:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1782727250.448239:0:5944:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1782727250.448242:0:5944:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1782727250.448298:0:5944:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1782727250.448300:0:5944:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1782727250.448555:0:5968:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:0.0:1782727250.448721:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1782727250.448742:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:0.0:1782727250.448755:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:0.0:1782727250.448764:0:5944:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1782727250.448766:0:5944:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1782727250.449211:0:5969:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1782727250.449351:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1782727250.449372:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1782727250.449384:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:0.0:1782727250.449395:0:5944:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1782727250.449397:0:5944:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:0.0:1782727250.449401:0:5944:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1782727250.449404:0:5944:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1782727250.449408:0:5944:0:(mgs_llog.c:5063:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1782727250.449413:0:5944:0:(mgs_llog.c:1376:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1782727250.449673:0:5970:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:0.0:1782727250.449776:0:5944:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1782727250.456071:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:0.0:1782727250.456109:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:0.0:1782727250.456126:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:0.0:1782727250.456144:0:5944:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1782727250.456165:0:5944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000dac767e4/0x14a47870ee88c8da lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727250.456181:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000dac767e4/0x14a47870ee88c8da lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727250.456191:0:5944:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000dac767e4/0x14a47870ee88c8da lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727250.456196:0:5944:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000dac767e4/0x14a47870ee88c8da lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727250.456202:0:5944:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000dac767e4/0x14a47870ee88c8da lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727250.456208:0:5944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000dac767e4/0x14a47870ee88c8da lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727250.456230:0:5944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000dac767e4 already unused, calling callback (0000000073239827) 00010000:00010000:0.0:1782727250.456234:0:5944:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000dac767e4/0x14a47870ee88c8da lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727250.456241:0:5944:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000dac767e4/0x14a47870ee88c8da lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727250.456252:0:5944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000dac767e4/0x14a47870ee88c8da lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727250.456259:0:5944:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000dac767e4/0x14a47870ee88c8da lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727250.456263:0:5944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000dac767e4/0x14a47870ee88c8da lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1782727250.456279:0:5944:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1782727250.466455:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008c8af633 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+5:5926:x1869324939690240:12345-0@lo:253: Request processed in 21840us (22066us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727250.466475:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782727250.466714:0:5926:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000003c90e6a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:5926:1869324939690240:0@lo:253: 10000000:01000000:1.0:1782727250.466730:0:5926:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1782727250.466733:0:5926:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1782727250.466735:0:5926:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1782727250.466736:0:5926:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782727250.466737:0:5926:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1782727250.466738:0:5926:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782727250.466739:0:5926:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782727250.466740:0:5926:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1782727250.466741:0:5926:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1782727250.466743:0:5926:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1782727250.466744:0:5926:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782727250.466745:0:5926:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1782727250.466762:0:5926:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000b6cd3216 from lustre-MDT0000 10000000:01000000:1.0:1782727250.466792:0:5926:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1782727250.466794:0:5926:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1782727250.466798:0:5926:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff921c519f0000 10000000:01000000:1.0:1782727250.466802:0:5926:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1782727250.466809:0:5926:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff921c519f0000 from 1 10000000:01000000:1.0:1782727250.466812:0:5926:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1782727250.466844:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: 00000000b15795cd/0x14a47870ee88c8e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727250.466854:0:5926:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: 00000000b15795cd/0x14a47870ee88c8e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727250.466861:0:5926:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: 00000000b15795cd/0x14a47870ee88c8e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727250.467108:0:5926:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000003c90e6a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:5926:1869324939690368:0@lo:101: 00000100:00100000:2.0:1782727250.467397:0:5926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727250.467449:0:5926:0:(client.c:2701:ptlrpc_set_wait()) set 000000003522acd4 going to sleep for 11 seconds 00000100:00100000:0.0:1782727250.467509:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939690368 00000100:00100000:0.0:1782727250.467516:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939690368 00000100:00100000:0.0:1782727250.467797:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782727250.467806:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003a076d4b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+5:5926:x1869324939690368:12345-0@lo:101: 00010000:00010000:0.0:1782727250.467818:0:5943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727250.467830:0:5943:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000dac767e4/0x14a47870ee88c8e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x14a47870ee88c8e1 expref: -99 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727250.467851:0:5943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000dac767e4/0x14a47870ee88c8e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x14a47870ee88c8e1 expref: 6 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727250.467866:0:5943:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000dac767e4/0x14a47870ee88c8e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x14a47870ee88c8e1 expref: 6 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727250.467874:0:5943:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000dac767e4, rc 0) 00000100:00100000:0.0:1782727250.468094:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003a076d4b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+6:5926:x1869324939690368:12345-0@lo:101: Request processed in 289us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727250.468100:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782727250.468171:0:5926:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000003c90e6a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:5926:1869324939690368:0@lo:101: 00010000:00010000:2.0:1782727250.468295:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: 00000000b15795cd/0x14a47870ee88c8e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88c8e8 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727250.468305:0:5926:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: 00000000b15795cd/0x14a47870ee88c8e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x14a47870ee88c8e8 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727250.468405:0:5926:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000db438877 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:5926:1869324939690496:0@lo:501: 00000100:00100000:2.0:1782727250.468429:0:5926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727250.468454:0:5926:0:(client.c:2701:ptlrpc_set_wait()) set 0000000058e179a2 going to sleep for 11 seconds 00000100:00100000:0.0:1782727250.468534:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939690496 00000100:00100000:0.0:1782727250.468538:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939690496 00000100:00100000:0.0:1782727250.468568:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782727250.468574:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000083a70566 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+6:5926:x1869324939690496:12345-0@lo:501: 00000100:00100000:0.0:1782727250.468733:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000083a70566 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+6:5926:x1869324939690496:12345-0@lo:501: Request processed in 159us (303us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782727250.468741:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782727250.468786:0:5926:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000db438877 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:5926:1869324939690496:0@lo:501: 10000000:01000000:1.0:1782727250.468813:0:5926:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1782727250.468863:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: 00000000b15795cd/0x14a47870ee88c8e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88c8e8 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727250.468872:0:5926:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: 00000000b15795cd/0x14a47870ee88c8e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88c8e8 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782727250.468907:0:5926:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff921c479c5800 10000000:01000000:1.0:1782727250.468913:0:5926:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1782727250.468918:0:5926:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff921c479c5800 10000000:01000000:1.0:1782727250.468920:0:5926:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1782727250.468924:0:5926:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff921c479c5800 from 1 10000000:01000000:1.0:1782727250.468926:0:5926:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1782727250.468944:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: 000000000c8cf0e0/0x14a47870ee88c8ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727250.468951:0:5926:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: 000000000c8cf0e0/0x14a47870ee88c8ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727250.468958:0:5926:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: 000000000c8cf0e0/0x14a47870ee88c8ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727250.468969:0:5926:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000000013af6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:5926:1869324939690624:0@lo:101: 00000100:00100000:1.0:1782727250.469007:0:5926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727250.469023:0:5926:0:(client.c:2701:ptlrpc_set_wait()) set 000000001540d050 going to sleep for 11 seconds 00000100:00100000:0.0:1782727250.469074:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939690624 00000100:00100000:0.0:1782727250.469078:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939690624 00000100:00100000:0.0:1782727250.469106:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782727250.469112:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000d613a23 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+6:5926:x1869324939690624:12345-0@lo:101: 00010000:00010000:0.0:1782727250.469119:0:5943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727250.469128:0:5943:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b30e5962/0x14a47870ee88c8f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x14a47870ee88c8ef expref: -99 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727250.469143:0:5943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b30e5962/0x14a47870ee88c8f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x14a47870ee88c8ef expref: 7 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727250.469151:0:5943:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b30e5962/0x14a47870ee88c8f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x14a47870ee88c8ef expref: 7 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727250.469168:0:5943:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b30e5962, rc 0) 00000100:00100000:0.0:1782727250.469200:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000d613a23 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+7:5926:x1869324939690624:12345-0@lo:101: Request processed in 88us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727250.469206:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1782727250.469311:0:5926:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000000013af6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:5926:1869324939690624:0@lo:101: 00010000:00010000:3.0:1782727250.469322:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: 000000000c8cf0e0/0x14a47870ee88c8ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88c8f6 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727250.469339:0:5926:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: 000000000c8cf0e0/0x14a47870ee88c8ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x14a47870ee88c8f6 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727250.469349:0:5926:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1782727250.469501:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: 000000000c8cf0e0/0x14a47870ee88c8ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88c8f6 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727250.469510:0:5926:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: 000000000c8cf0e0/0x14a47870ee88c8ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88c8f6 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727250.469515:0:5926:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1782727250.469519:0:5926:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1782727250.469523:0:5926:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff921c479c5800 10000000:01000000:3.0:1782727250.469526:0:5926:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1782727250.469528:0:5926:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1782727250.469530:0:5926:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1782727250.469554:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: 000000005b11f51c/0x14a47870ee88c8fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727250.469560:0:5926:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: 000000005b11f51c/0x14a47870ee88c8fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727250.469565:0:5926:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: 000000005b11f51c/0x14a47870ee88c8fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727250.469576:0:5926:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000578e70a5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:5926:1869324939690752:0@lo:101: 00000100:00100000:3.0:1782727250.469622:0:5926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727250.469647:0:5926:0:(client.c:2701:ptlrpc_set_wait()) set 000000006f62c91a going to sleep for 11 seconds 00000100:00100000:0.0:1782727250.469691:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939690752 00000100:00100000:0.0:1782727250.469695:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939690752 00000100:00100000:0.0:1782727250.469725:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782727250.469731:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000042d90956 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+7:5926:x1869324939690752:12345-0@lo:101: 00010000:00010000:0.0:1782727250.469738:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727250.469745:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b9067395/0x14a47870ee88c904 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x14a47870ee88c8fd expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727250.469757:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b9067395/0x14a47870ee88c904 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x14a47870ee88c8fd expref: 8 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727250.469764:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b9067395/0x14a47870ee88c904 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x14a47870ee88c8fd expref: 8 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727250.469771:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b9067395, rc 0) 00000100:00100000:0.0:1782727250.469802:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000042d90956 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+8:5926:x1869324939690752:12345-0@lo:101: Request processed in 71us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727250.469807:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782727250.469925:0:5926:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000578e70a5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:5926:1869324939690752:0@lo:101: 00010000:00010000:3.0:1782727250.469935:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: 000000005b11f51c/0x14a47870ee88c8fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88c904 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727250.469940:0:5926:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: 000000005b11f51c/0x14a47870ee88c8fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x14a47870ee88c904 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727250.469983:0:5926:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000578e70a5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:5926:1869324939690880:0@lo:501: 00000100:00100000:3.0:1782727250.470005:0:5926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727250.470024:0:5926:0:(client.c:2701:ptlrpc_set_wait()) set 000000006f62c91a going to sleep for 11 seconds 00000100:00100000:1.0:1782727250.470075:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939690880 00000100:00100000:1.0:1782727250.470080:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939690880 00000100:00100000:1.0:1782727250.470103:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782727250.470110:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b3144d59 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+8:5926:x1869324939690880:12345-0@lo:501: 00000100:00100000:1.0:1782727250.470214:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b3144d59 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+9:5926:x1869324939690880:12345-0@lo:501: Request processed in 105us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727250.470221:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782727250.470279:0:5926:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000578e70a5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:5926:1869324939690880:0@lo:501: 00000100:00100000:3.0:1782727250.470305:0:5926:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000578e70a5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:5926:1869324939691008:0@lo:503: 00000100:00100000:3.0:1782727250.470340:0:5926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727250.470359:0:5926:0:(client.c:2701:ptlrpc_set_wait()) set 000000006f62c91a going to sleep for 11 seconds 00000100:00100000:1.0:1782727250.470398:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939691008 00000100:00100000:1.0:1782727250.470402:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939691008 00000100:00100000:1.0:1782727250.470432:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782727250.470438:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fd4a74b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+9:5926:x1869324939691008:12345-0@lo:503: 00000100:00100000:1.0:1782727250.470506:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fd4a74b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+9:5926:x1869324939691008:12345-0@lo:503: Request processed in 68us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727250.470512:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782727250.470586:0:5926:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000578e70a5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:5926:1869324939691008:0@lo:503: 00000100:00100000:3.0:1782727250.470964:0:5971:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000578e70a5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c71e9f0f-6441-4b9b-bc96-153ab9250801:5971:1869324939691136:0@lo:502: 00000100:00100000:3.0:1782727250.471000:0:5971:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727250.471024:0:5971:0:(client.c:2701:ptlrpc_set_wait()) set 000000004f58f6d6 going to sleep for 11 seconds 00000100:00100000:1.0:1782727250.471075:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939691136 00000100:00100000:1.0:1782727250.471080:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939691136 00000100:00100000:1.0:1782727250.471111:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1782727250.471117:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ac7ff9e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+9:5971:x1869324939691136:12345-0@lo:502: 00000100:00100000:1.0:1782727250.471195:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ac7ff9e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+9:5971:x1869324939691136:12345-0@lo:502: Request processed in 78us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727250.471201:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782727250.471272:0:5971:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000578e70a5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c71e9f0f-6441-4b9b-bc96-153ab9250801:5971:1869324939691136:0@lo:502: 00000020:01000000:3.0:1782727250.471291:0:5971:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782727250.471302:0:5971:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782727250.471304:0:5971:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1782727250.471308:0:5971:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1782727250.471310:0:5971:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1782727250.471323:0:5971:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000003bd546e1) 00000020:00000080:3.0:1782727250.471339:0:5971:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1782727250.471349:0:5971:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1782727250.471424:0:5971:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:3.0:1782727250.471430:0:5971:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x14a47870ee88c912 00000020:00000080:3.0:1782727250.471668:0:5971:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1782727250.471673:0:5971:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782727250.471676:0:5971:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782727250.471677:0:5971:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1782727250.471680:0:5971:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782727250.471684:0:5971:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782727250.471685:0:5971:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1782727250.471688:0:5971:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1782727250.471694:0:5971:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000e28d576c) 00000020:00000080:3.0:1782727250.471703:0:5971:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1782727250.471707:0:5971:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1782727250.471708:0:5971:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1782727250.471711:0:5971:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1782727250.471716:0:5971:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1782727250.471749:0:5971:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000b6cd3216 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1782727250.471758:0:5971:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000aa2bb85e) 00000020:00000080:3.0:1782727250.471764:0:5971:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1782727250.471819:0:5971:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1782727250.471823:0:5971:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x14a47870ee88c927 00000020:00000080:3.0:1782727250.472061:0:5971:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1782727250.472067:0:5971:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1782727250.472072:0:5971:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x14a47870ee88c92e 00080000:01000000:3.0:1782727250.472076:0:5971:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:3.0:1782727250.472079:0:5971:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x14a47870ee88c935 00080000:10000000:3.0:1782727250.472460:0:5971:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:3.0:1782727250.472626:0:5971:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1782727250.477485:0:5971:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:1.0:1782727250.525958:0:5971:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:1.0:1782727250.526333:0:5971:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:1.0:1782727250.528772:0:5971:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1782727250.529452:0:5971:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1782727250.534173:0:5971:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000079a92fbc) 00000020:00000080:1.0:1782727250.534194:0:5971:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1782727250.534294:0:5971:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:1.0:1782727250.534307:0:5971:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x14a47870ee88c943 00000020:00000080:2.0:1782727250.536439:0:5971:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1782727250.537397:0:5971:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:2.0:1782727250.540175:0:5971:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:2.0:1782727250.542219:0:5971:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:2.0:1782727250.545346:0:5971:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:1.0:1782727250.550571:0:5971:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:1.0:1782727250.553368:0:5971:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:1.0:1782727250.554794:0:5971:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x14a47870ee88c94a 00000020:00000080:1.0:1782727250.555286:0:5971:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1782727250.555297:0:5971:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782727250.555303:0:5971:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782727250.555306:0:5971:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1782727250.555308:0:5971:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782727250.555313:0:5971:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782727250.555314:0:5971:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:1.0:1782727250.555317:0:5971:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1782727250.555318:0:5971:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1782727250.555321:0:5971:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782727250.555323:0:5971:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782727250.555324:0:5971:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:1.0:1782727250.555326:0:5971:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782727250.555330:0:5971:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782727250.555331:0:5971:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1782727250.555335:0:5971:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1782727250.555380:0:5971:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:1.0:1782727250.555434:0:5971:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000594264e8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c71e9f0f-6441-4b9b-bc96-153ab9250801:5971:1869324939691264:0@lo:502: 00000100:00100000:1.0:1782727250.555507:0:5971:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727250.555554:0:5971:0:(client.c:2701:ptlrpc_set_wait()) set 00000000498fe3c7 going to sleep for 11 seconds 00000100:00100000:0.0:1782727250.555613:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939691264 00000100:00100000:0.0:1782727250.555620:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939691264 00000100:00100000:0.0:1782727250.555662:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782727250.555670:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ebec3c4f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+9:5971:x1869324939691264:12345-0@lo:502: 00000100:00100000:0.0:1782727250.555779:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ebec3c4f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+9:5971:x1869324939691264:12345-0@lo:502: Request processed in 110us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727250.555792:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782727250.555863:0:5971:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000594264e8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c71e9f0f-6441-4b9b-bc96-153ab9250801:5971:1869324939691264:0@lo:502: 00000020:01000000:1.0:1782727250.555926:0:5971:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782727250.555931:0:5971:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782727250.555932:0:5971:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:1.0:1782727250.555935:0:5971:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1782727250.555993:0:5926:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1782727250.556014:0:5926:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1782727250.556044:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: 000000005b11f51c/0x14a47870ee88c8fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88c904 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727250.556056:0:5926:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: 000000005b11f51c/0x14a47870ee88c8fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88c904 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782727250.556063:0:5926:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff921c479c5800 from 1 10000000:01000000:1.0:1782727250.556066:0:5926:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1782727250.556091:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: 0000000020ea91d1/0x14a47870ee88c951 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727250.556098:0:5926:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: 0000000020ea91d1/0x14a47870ee88c951 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727250.556106:0:5926:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: 0000000020ea91d1/0x14a47870ee88c951 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727250.556118:0:5926:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000594264e8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:5926:1869324939691392:0@lo:101: 00000100:00100000:1.0:1782727250.556144:0:5926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727250.556162:0:5926:0:(client.c:2701:ptlrpc_set_wait()) set 00000000498fe3c7 going to sleep for 11 seconds 00000100:00100000:3.0:1782727250.556340:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939691392 00000100:00100000:3.0:1782727250.556346:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939691392 00000100:00100000:3.0:1782727250.556381:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1782727250.556387:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000066587649 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+9:5926:x1869324939691392:12345-0@lo:101: 00010000:00010000:3.0:1782727250.556402:0:5942:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727250.556413:0:5942:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000036085c4b/0x14a47870ee88c958 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x14a47870ee88c951 expref: -99 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727250.556431:0:5942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000036085c4b/0x14a47870ee88c958 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x14a47870ee88c951 expref: 10 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727250.556441:0:5942:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000036085c4b/0x14a47870ee88c958 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x14a47870ee88c951 expref: 10 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727250.556448:0:5942:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000036085c4b, rc 0) 00000100:00100000:3.0:1782727250.556477:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000066587649 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+10:5926:x1869324939691392:12345-0@lo:101: Request processed in 90us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727250.556482:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782727250.556626:0:5926:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000594264e8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:5926:1869324939691392:0@lo:101: 00010000:00010000:1.0:1782727250.556638:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: 0000000020ea91d1/0x14a47870ee88c951 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88c958 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727250.556645:0:5926:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: 0000000020ea91d1/0x14a47870ee88c951 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x14a47870ee88c958 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727250.557412:0:5926:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000594264e8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:5926:1869324939691520:0@lo:256: 00000100:00100000:1.0:1782727250.557456:0:5926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727250.558479:0:5926:0:(client.c:2701:ptlrpc_set_wait()) set 00000000498fe3c7 going to sleep for 11 seconds 00000100:00100000:3.0:1782727250.558521:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939691520 00000100:00100000:3.0:1782727250.558527:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939691520 00000100:00100000:3.0:1782727250.558616:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1782727250.558625:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000013832cab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+10:5926:x1869324939691520:12345-0@lo:256: 20000000:01000000:3.0:1782727250.558645:0:5942:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1782727250.558651:0:5942:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1782727250.558743:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000013832cab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+10:5926:x1869324939691520:12345-0@lo:256: Request processed in 119us (1286us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727250.558751:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782727250.558816:0:5926:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000594264e8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:5926:1869324939691520:0@lo:256: 10000000:01000000:1.0:1782727250.559446:0:5926:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1782727250.559463:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: 0000000020ea91d1/0x14a47870ee88c951 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88c958 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727250.559472:0:5926:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: 0000000020ea91d1/0x14a47870ee88c951 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88c958 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782727250.559479:0:5926:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff921c479c5800 from 1 10000000:01000000:1.0:1782727250.559482:0:5926:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782727250.559511:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: 00000000d0cdb029/0x14a47870ee88c95f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727250.559518:0:5926:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: 00000000d0cdb029/0x14a47870ee88c95f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727250.559524:0:5926:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: 00000000d0cdb029/0x14a47870ee88c95f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727250.559539:0:5926:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000594264e8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:5926:1869324939691648:0@lo:101: 00000100:00100000:1.0:1782727250.559569:0:5926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727250.559860:0:5926:0:(client.c:2701:ptlrpc_set_wait()) set 00000000498fe3c7 going to sleep for 11 seconds 00000100:00100000:0.0:1782727250.559979:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939691648 00000100:00100000:0.0:1782727250.559985:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939691648 00000100:00100000:0.0:1782727250.560014:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1782727250.560019:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e6b5cb7e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+10:5926:x1869324939691648:12345-0@lo:101: 00010000:00010000:0.0:1782727250.560039:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727250.560051:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d31816c0/0x14a47870ee88c966 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x14a47870ee88c95f expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727250.560073:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d31816c0/0x14a47870ee88c966 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x14a47870ee88c95f expref: 11 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727250.560083:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d31816c0/0x14a47870ee88c966 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x14a47870ee88c95f expref: 11 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727250.560090:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d31816c0, rc 0) 00000100:00100000:0.0:1782727250.560123:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e6b5cb7e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+11:5926:x1869324939691648:12345-0@lo:101: Request processed in 104us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727250.560129:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782727250.560204:0:5926:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000594264e8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:5926:1869324939691648:0@lo:101: 00010000:00010000:1.0:1782727250.560213:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: 00000000d0cdb029/0x14a47870ee88c95f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88c966 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727250.560221:0:5926:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: 00000000d0cdb029/0x14a47870ee88c95f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x14a47870ee88c966 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727250.560285:0:5926:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000594264e8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:5926:1869324939691776:0@lo:501: 00000100:00100000:1.0:1782727250.560310:0:5926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727250.560334:0:5926:0:(client.c:2701:ptlrpc_set_wait()) set 00000000498fe3c7 going to sleep for 11 seconds 00000100:00100000:0.0:1782727250.560424:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939691776 00000100:00100000:0.0:1782727250.560429:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939691776 00000100:00100000:0.0:1782727250.560446:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1782727250.560451:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002001b1ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+11:5926:x1869324939691776:12345-0@lo:501: 00000100:00100000:0.0:1782727250.560622:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002001b1ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+11:5926:x1869324939691776:12345-0@lo:501: Request processed in 170us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727250.560629:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782727250.560738:0:5926:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000594264e8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:5926:1869324939691776:0@lo:501: 00000100:00100000:1.0:1782727250.560765:0:5926:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000594264e8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:5926:1869324939691904:0@lo:503: 00000100:00100000:1.0:1782727250.560804:0:5926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727250.560827:0:5926:0:(client.c:2701:ptlrpc_set_wait()) set 00000000498fe3c7 going to sleep for 11 seconds 00000100:00100000:0.0:1782727250.560863:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939691904 00000100:00100000:0.0:1782727250.560867:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939691904 00000100:00100000:0.0:1782727250.560929:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1782727250.560935:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cd71344c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+11:5926:x1869324939691904:12345-0@lo:503: 00000040:00080000:0.0:1782727250.560962:0:5944:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1782727250.560992:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cd71344c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+11:5926:x1869324939691904:12345-0@lo:503: Request processed in 58us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727250.560998:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1782727250.561186:0:5926:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000594264e8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:5926:1869324939691904:0@lo:503: 00000040:00080000:3.0:1782727250.561995:0:5975:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1782727250.562515:0:5926:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1782727250.562536:0:5926:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782727250.562560:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: 00000000d0cdb029/0x14a47870ee88c95f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88c966 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727250.562571:0:5926:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: 00000000d0cdb029/0x14a47870ee88c95f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88c966 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782727250.562628:0:5926:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1782727250.562631:0:5926:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff921c479c5800 10000000:01000000:1.0:1782727250.562634:0:5926:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff921c479c5800 10000000:01000000:1.0:1782727250.562637:0:5926:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1782727250.562642:0:5926:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff921c479c5800 from 1 10000000:01000000:1.0:1782727250.562644:0:5926:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1782727250.562670:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: 00000000d61ac525/0x14a47870ee88c96d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727250.562678:0:5926:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: 00000000d61ac525/0x14a47870ee88c96d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727250.562693:0:5926:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: 00000000d61ac525/0x14a47870ee88c96d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727250.562711:0:5926:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000594264e8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:5926:1869324939692032:0@lo:101: 00000100:00100000:1.0:1782727250.562757:0:5926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727250.562829:0:5926:0:(client.c:2701:ptlrpc_set_wait()) set 00000000787b65ec going to sleep for 11 seconds 00000100:00100000:2.0:1782727250.562992:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939692032 00000100:00100000:2.0:1782727250.562999:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939692032 00000100:00100000:0.0:1782727250.563237:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1782727250.563246:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008f40e96a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+11:5926:x1869324939692032:12345-0@lo:101: 00010000:00010000:0.0:1782727250.563257:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727250.563268:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006aa38e27/0x14a47870ee88c974 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x14a47870ee88c96d expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727250.563288:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006aa38e27/0x14a47870ee88c974 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x14a47870ee88c96d expref: 12 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727250.563296:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006aa38e27/0x14a47870ee88c974 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x14a47870ee88c96d expref: 12 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727250.563304:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006aa38e27, rc 0) 00000100:00100000:0.0:1782727250.563348:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008f40e96a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+12:5926:x1869324939692032:12345-0@lo:101: Request processed in 104us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727250.563355:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1782727250.563430:0:5926:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000594264e8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:5926:1869324939692032:0@lo:101: 00010000:00010000:1.0:1782727250.563443:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: 00000000d61ac525/0x14a47870ee88c96d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88c974 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727250.563451:0:5926:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: 00000000d61ac525/0x14a47870ee88c96d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x14a47870ee88c974 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727250.563501:0:5926:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000594264e8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:5926:1869324939692160:0@lo:501: 00000100:00100000:1.0:1782727250.563524:0:5926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727250.563551:0:5926:0:(client.c:2701:ptlrpc_set_wait()) set 00000000787b65ec going to sleep for 11 seconds 00000100:00100000:3.0:1782727250.563592:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939692160 00000100:00100000:3.0:1782727250.563605:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939692160 00000100:00100000:3.0:1782727250.563634:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1782727250.563640:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005597a67c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+12:5926:x1869324939692160:12345-0@lo:501: 00000100:00100000:3.0:1782727250.563747:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005597a67c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+12:5926:x1869324939692160:12345-0@lo:501: Request processed in 108us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727250.563764:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1782727250.563820:0:5926:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000594264e8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:5926:1869324939692160:0@lo:501: 00000100:00100000:1.0:1782727250.563845:0:5926:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000594264e8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:5926:1869324939692288:0@lo:503: 00000100:00100000:1.0:1782727250.563879:0:5926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727250.563927:0:5926:0:(client.c:2701:ptlrpc_set_wait()) set 00000000787b65ec going to sleep for 11 seconds 00000100:00100000:3.0:1782727250.563976:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939692288 00000100:00100000:3.0:1782727250.563980:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939692288 00000100:00100000:3.0:1782727250.563996:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1782727250.564000:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000070e0b373 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+12:5926:x1869324939692288:12345-0@lo:503: 00000100:00100000:3.0:1782727250.564206:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000070e0b373 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+12:5926:x1869324939692288:12345-0@lo:503: Request processed in 205us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727250.564212:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1782727250.564274:0:5926:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000594264e8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:5926:1869324939692288:0@lo:503: 00000100:00100000:1.0:1782727250.564562:0:5976:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000594264e8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c71e9f0f-6441-4b9b-bc96-153ab9250801:5976:1869324939692416:0@lo:502: 00000100:00100000:1.0:1782727250.564606:0:5976:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727250.564626:0:5976:0:(client.c:2701:ptlrpc_set_wait()) set 000000003bf78959 going to sleep for 11 seconds 00000100:00100000:3.0:1782727250.564666:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939692416 00000100:00100000:3.0:1782727250.564671:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939692416 00000100:00100000:3.0:1782727250.564691:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1782727250.564696:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fc2fc0e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+12:5976:x1869324939692416:12345-0@lo:502: 00000100:00100000:3.0:1782727250.564773:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fc2fc0e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+12:5976:x1869324939692416:12345-0@lo:502: Request processed in 76us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727250.564779:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1782727250.564842:0:5976:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000594264e8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c71e9f0f-6441-4b9b-bc96-153ab9250801:5976:1869324939692416:0@lo:502: 00000020:01000004:1.0:1782727250.564931:0:5976:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1782727250.564945:0:5976:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000082cea36) 00000020:00000080:1.0:1782727250.564962:0:5976:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1782727250.565264:0:5976:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000b6cd3216 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1782727250.565268:0:5976:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000b6cd3216 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1782727250.565270:0:5976:0:(obd_mount.c:701:lustre_put_lsi()) put 00000000b6cd3216 4 00010000:00080000:1.0:1782727250.565307:0:5976:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000b0beb8d4@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.160@tcp at head 00010000:00010000:0.0:1782727250.572739:0:5976:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1782727250.572830:0:5976:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1782727250.572879:0:5976:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1782727250.572916:0:5976:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x14a47870ee88c982 00000100:00080000:0.0:1782727250.572927:0:5976:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1782727250.572931:0:5976:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000b0beb8d4 using connection 192.168.202.160@tcp/0@lo 00000100:00100000:0.0:1782727250.572976:0:5976:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000065cca07c x1869324939692544/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1782727250.573065:0:3441:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000065cca07c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3441:1869324939692544:0@lo:38: 00000100:00100000:2.0:1782727250.573131:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1782727250.573290:0:5976:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1782727250.573405:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939692544 00000100:00100000:3.0:1782727250.573413:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939692544 00000100:00100000:3.0:1782727250.573442:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782727250.573449:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009d17aa45 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3441:x1869324939692544:12345-0@lo:38: 00000100:00100000:3.0:1782727250.575732:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009d17aa45 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3441:x1869324939692544:12345-0@lo:38: Request processed in 2278us (2596us total) trans 0 rc -11/-11 00000100:00100000:3.0:1782727250.575746:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782727250.576264:0:5976:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000578e70a5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c71e9f0f-6441-4b9b-bc96-153ab9250801:5976:1869324939692672:0@lo:502: 00000100:00100000:3.0:1782727250.576327:0:5976:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727250.576360:0:5976:0:(client.c:2701:ptlrpc_set_wait()) set 00000000f71288d1 going to sleep for 11 seconds 00000100:00100000:0.0:1782727250.576401:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939692672 00000100:00100000:0.0:1782727250.576406:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939692672 00000100:00100000:0.0:1782727250.576450:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1782727250.576457:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b30982c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+12:5976:x1869324939692672:12345-0@lo:502: 00000100:00100000:0.0:1782727250.576558:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b30982c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+12:5976:x1869324939692672:12345-0@lo:502: Request processed in 101us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727250.576565:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1782727250.576652:0:5976:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000578e70a5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c71e9f0f-6441-4b9b-bc96-153ab9250801:5976:1869324939692672:0@lo:502: 00000040:00080000:3.0:1782727250.576686:0:5976:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1782727250.576797:0:5926:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1782727250.576818:0:5926:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1782727250.576836:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: 00000000d61ac525/0x14a47870ee88c96d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88c974 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727250.576845:0:5926:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: 00000000d61ac525/0x14a47870ee88c96d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88c974 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1782727250.576909:0:5926:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1782727250.576911:0:5926:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1782727250.576913:0:5926:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782727250.576914:0:5926:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782727250.576915:0:5926:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782727250.576916:0:5926:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782727250.576917:0:5926:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1782727250.576919:0:5926:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1782727250.576920:0:5926:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1782727250.576921:0:5926:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1782727250.576923:0:5926:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782727250.576924:0:5926:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1782727250.576927:0:5926:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1782727250.576929:0:5926:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1782727250.576931:0:5926:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1782727250.576936:0:5926:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782727250.576937:0:5926:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782727250.576937:0:5926:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782727250.576938:0:5926:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782727250.576939:0:5926:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1782727250.576940:0:5926:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1782727250.576941:0:5926:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1782727250.576941:0:5926:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1782727250.576942:0:5926:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782727250.576943:0:5926:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1782727250.576957:0:5926:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1782727250.576966:0:5926:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001a8415e8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:5926:1869324939692800:0@lo:253: 00000100:00100000:0.0:1782727250.576994:0:5926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727250.577006:0:5926:0:(client.c:2701:ptlrpc_set_wait()) set 00000000ccfeb62a going to sleep for 11 seconds 00000100:00100000:3.0:1782727250.577322:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939692800 00000100:00100000:3.0:1782727250.577327:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939692800 00000100:00100000:3.0:1782727250.577360:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1782727250.577366:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003aa0c3e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+12:5926:x1869324939692800:12345-0@lo:253: 20000000:01000000:3.0:1782727250.577391:0:5942:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1782727250.577404:0:5942:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1782727250.577833:0:3441:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1782727250.577841:0:3441:0:(import.c:65:import_set_state_nolock()) 00000000b0beb8d4 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1782727250.577846:0:3441:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1782727250.577850:0:3441:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000065cca07c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3441:1869324939692544:0@lo:38: 20000000:01000000:3.0:1782727250.588498:0:5942:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1782727250.588517:0:5942:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1782727250.588731:0:5965:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1782727250.588736:0:5965:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1782727250.588759:0:5965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000073f0791c/0x14a47870ee88c989 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727250.588788:0:5965:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000036085c4b/0x14a47870ee88c958 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x14a47870ee88c951 expref: 12 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727250.588796:0:5965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000073f0791c/0x14a47870ee88c989 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727250.588829:0:5965:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000036085c4b/0x14a47870ee88c958 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x14a47870ee88c951 expref: 12 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727250.588842:0:5965:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000036085c4b/0x14a47870ee88c958 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x14a47870ee88c951 expref: 12 pid: 5942 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727250.588855:0:5965:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000cb735120 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5965:1869324939692928:0@lo:104: 00000100:00100000:2.0:1782727250.588943:0:5965:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727250.588985:0:5965:0:(client.c:2701:ptlrpc_set_wait()) set 00000000f7ecebbb going to sleep for 11 seconds 00000100:00100000:1.0:1782727250.589325:0:5932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939692928 00000100:00100000:1.0:1782727250.589333:0:5932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939692928 00000100:00100000:1.0:1782727250.589376:0:5932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782727250.589382:0:5932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000011752238 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c71e9f0f-6441-4b9b-bc96-153ab9250801+3:5965:x1869324939692928:12345-0@lo:104: 00010000:00010000:1.0:1782727250.589393:0:5932:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.160@tcp lock: 0000000020ea91d1/0x14a47870ee88c951 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x14a47870ee88c958 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727250.589440:0:5932:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782727250.589445:0:5932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000011752238 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c71e9f0f-6441-4b9b-bc96-153ab9250801+3:5965:x1869324939692928:12345-0@lo:104: Request processed in 64us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727250.589452:0:5932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1782727250.589563:0:5937:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782727250.589568:0:5937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: 0000000020ea91d1/0x14a47870ee88c951 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x14a47870ee88c958 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727250.589575:0:5937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000020ea91d1 already unused, calling callback (000000000d1db875) 10000000:00010000:3.0:1782727250.589577:0:5937:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: 0000000020ea91d1/0x14a47870ee88c951 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x14a47870ee88c958 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727250.589585:0:5937:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: 0000000020ea91d1/0x14a47870ee88c951 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x14a47870ee88c958 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782727250.589591:0:5937:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: 0000000020ea91d1/0x14a47870ee88c951 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x14a47870ee88c958 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727250.589607:0:5937:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1782727250.589633:0:5937:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: 0000000020ea91d1/0x14a47870ee88c951 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x14a47870ee88c958 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727250.589639:0:5937:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782727250.589650:0:5937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: 0000000020ea91d1/0x14a47870ee88c951 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x14a47870ee88c958 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727250.589667:0:5937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: 0000000020ea91d1/0x14a47870ee88c951 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x14a47870ee88c958 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727250.589679:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727250.589681:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727250.589682:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727250.589727:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003aa0c3e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+12:5926:x1869324939692800:12345-0@lo:253: Request processed in 12362us (12732us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727250.589734:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1782727250.589916:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782727250.589926:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000578e70a5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c71e9f0f-6441-4b9b-bc96-153ab9250801:3442:1869324939693056:0@lo:103: 00000100:00100000:0.0:1782727250.589954:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727250.590003:0:5926:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001a8415e8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:5926:1869324939692800:0@lo:253: 10000000:01000000:0.0:1782727250.590012:0:5926:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1782727250.590015:0:5926:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1782727250.590017:0:5926:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1782727250.590018:0:5926:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782727250.590019:0:5926:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782727250.590020:0:5926:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782727250.590022:0:5926:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782727250.590023:0:5926:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1782727250.590024:0:5926:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1782727250.590025:0:5926:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1782727250.590037:0:5926:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1782727250.590038:0:5926:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782727250.590039:0:5926:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1782727250.590050:0:5926:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1782727250.592830:0:5934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939693056 00000100:00100000:3.0:1782727250.592842:0:5934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939693056 00010000:00010000:3.0:1782727250.592869:0:5934:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000036085c4b/0x14a47870ee88c958 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x14a47870ee88c951 expref: 12 pid: 5942 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727250.592913:0:5934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782727250.592919:0:5934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000239ba14f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c71e9f0f-6441-4b9b-bc96-153ab9250801+12:3442:x1869324939693056:12345-0@lo:103: 00010000:00010000:3.0:1782727250.592931:0:5934:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782727250.592935:0:5934:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000036085c4b/0x14a47870ee88c958 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x14a47870ee88c951 expref: 12 pid: 5942 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727250.592945:0:5934:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000036085c4b/0x14a47870ee88c958 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x14a47870ee88c951 expref: 12 pid: 5942 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727250.592962:0:5934:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000073f0791c/0x14a47870ee88c989 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727250.592969:0:5934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000073f0791c/0x14a47870ee88c989 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1782727250.592994:0:5934:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004259243s 00010000:00010000:3.0:1782727250.592998:0:5934:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000073f0791c/0x14a47870ee88c989 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727250.593004:0:5934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000073f0791c/0x14a47870ee88c989 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727250.593009:0:5934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000073f0791c/0x14a47870ee88c989 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727250.593013:0:5934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000073f0791c/0x14a47870ee88c989 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727250.593019:0:5934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000073f0791c already unused, calling callback (0000000073239827) 00010000:00010000:3.0:1782727250.593021:0:5934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000073f0791c/0x14a47870ee88c989 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727250.593040:0:5934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000073f0791c/0x14a47870ee88c989 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727250.593048:0:5934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000073f0791c/0x14a47870ee88c989 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727250.593057:0:5934:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782727250.593120:0:5934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000239ba14f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c71e9f0f-6441-4b9b-bc96-153ab9250801+12:3442:x1869324939693056:12345-0@lo:103: Request processed in 200us (3165us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727250.593127:0:5934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1782727250.593412:0:5965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000036085c4b/0x14a47870ee88c958 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x14a47870ee88c951 expref: 11 pid: 5942 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727250.593426:0:5965:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000cb735120 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5965:1869324939692928:0@lo:104: 00010000:00010000:2.0:1782727250.593445:0:5965:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000073f0791c/0x14a47870ee88c989 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727250.593453:0:5965:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000073f0791c/0x14a47870ee88c989 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727250.593457:0:5965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000073f0791c/0x14a47870ee88c989 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727250.593462:0:5965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000073f0791c/0x14a47870ee88c989 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727250.597407:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000578e70a5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c71e9f0f-6441-4b9b-bc96-153ab9250801:3442:1869324939693056:0@lo:103: 00080000:10000000:0.0:1782727250.599145:0:5926:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:0.0:1782727250.600324:0:5926:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1782727250.600566:0:5926:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:0.0:1782727250.600773:0:5926:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1782727250.602281:0:5926:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:0.0:1782727250.602474:0:5926:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:0.0:1782727250.603719:0:5926:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:0.0:1782727250.603929:0:5926:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:0.0:1782727250.604171:0:5926:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:0.0:1782727250.604341:0:5926:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:0.0:1782727250.604546:0:5926:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:0.0:1782727250.604728:0:5926:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:3.0:1782727250.607837:0:5926:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1782727250.616087:0:5926:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1782727250.616216:0:5981:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1782727250.616221:0:5981:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1782727250.616469:0:5982:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1782727250.618315:0:5926:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1782727250.618425:0:5926:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1782727250.618858:0:5926:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1782727250.618866:0:5926:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1782727250.619012:0:5926:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782727250.622135:0:5982:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782727250.622455:0:5926:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1782727250.626643:0:5982:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1782727250.626723:0:5982:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1782727250.626727:0:5982:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:0.0:1782727250.626938:0:5926:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1782727250.626981:0:5926:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1782727250.627208:0:5926:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1782727250.627442:0:5926:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:0.0:1782727250.628084:0:5926:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1782727250.628213:0:5926:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1782727250.628363:0:5926:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1782727250.628509:0:5926:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1782727250.628679:0:5926:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1782727250.628808:0:5926:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1782727250.628992:0:5926:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1782727250.629123:0:5926:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1782727250.629259:0:5926:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1782727250.629406:0:5926:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1782727250.629556:0:5926:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1782727250.630160:0:5926:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1782727250.630396:0:5926:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1782727250.630560:0:5926:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1782727250.630723:0:5926:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1782727250.630852:0:5926:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1782727250.631294:0:5926:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1782727250.631448:0:5926:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1782727250.631625:0:5926:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1782727250.631766:0:5926:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1782727250.632112:0:5926:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1782727250.632263:0:5926:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1782727250.632381:0:5926:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1782727250.632521:0:5926:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1782727250.632684:0:5926:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1782727250.632833:0:5926:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1782727250.633071:0:5926:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1782727250.633217:0:5926:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1782727250.633346:0:5926:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1782727250.633502:0:5926:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1782727250.633659:0:5926:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1782727250.633796:0:5926:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1782727250.634096:0:5926:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:0.0:1782727250.636880:0:5926:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1782727250.636970:0:5926:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffaeeac1a1b988 00100000:10000000:0.0:1782727250.636977:0:5926:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1782727250.637685:0:5926:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1782727250.637699:0:5926:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.160@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1782727250.637717:0:5926:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1782727250.637735:0:5926:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1782727250.638499:0:5926:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1782727250.638666:0:5926:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1782727251.386832:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727252.408988:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727253.434235:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727254.457204:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782727255.123195:0:6227:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg260-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1782727255.488381:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727255.737591:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:1.0:1782727255.737619:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1782727255.737624:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1782727255.737626:0:37:0:(import.c:65:import_set_state_nolock()) 00000000b0beb8d4 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1782727255.737640:0:37:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000b0beb8d4 using connection 192.168.202.160@tcp/0@lo 00000100:00100000:1.0:1782727255.737673:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000c004f297 x1869324939693312/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782727255.738211:0:3441:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000c004f297 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3441:1869324939693312:0@lo:38: 00000100:00100000:0.0:1782727255.738291:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727255.738601:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939693312 00000100:00100000:1.0:1782727255.738610:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939693312 00000100:00100000:1.0:1782727255.738650:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782727255.738657:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001a8415e8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3441:x1869324939693312:12345-0@lo:38: 00010000:00080000:1.0:1782727255.738685:0:5950:0:(ldlm_lib.c:1434:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 150 last 0 00000020:00000080:1.0:1782727255.738717:0:5950:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x14a47870ee88c990 00000004:00100000:1.0:1782727255.738755:0:5950:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1782727255.738858:0:5950:0:(import.c:65:import_set_state_nolock()) 000000005dcdcffb : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782727255.738944:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001a8415e8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3441:x1869324939693312:12345-0@lo:38: Request processed in 286us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727255.738953:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1782727255.739005:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000c004f297 x1869324939693312/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782727265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1782727255.739020:0:3441:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1782727255.739026:0:3441:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1782727255.739031:0:3441:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1782727255.739033:0:3441:0:(import.c:65:import_set_state_nolock()) 00000000b0beb8d4 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1782727255.739038:0:3441:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000c004f297 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3441:1869324939693312:0@lo:38: 00000100:00100000:2.0:1782727255.742404:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000594264e8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c71e9f0f-6441-4b9b-bc96-153ab9250801:3445:1869324939693184:0@lo:400: 00000100:00100000:2.0:1782727255.742488:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727255.743337:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939693184 00000100:00100000:1.0:1782727255.743346:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939693184 00000100:00100000:1.0:1782727255.743398:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1782727255.743406:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000660b3aab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+11:3445:x1869324939693184:12345-0@lo:400: 00000100:00100000:1.0:1782727255.743468:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000660b3aab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+11:3445:x1869324939693184:12345-0@lo:400: Request processed in 63us (981us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727255.743485:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1782727255.747047:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000594264e8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c71e9f0f-6441-4b9b-bc96-153ab9250801:3445:1869324939693184:0@lo:400: 00000020:00000004:1.0:1782727256.233432:0:6279:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1782727256.233710:0:6279:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1782727256.508179:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782727256.761961:0:5946:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1782727256.761969:0:5946:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff921c479c5800 from 3 10000000:01000000:0.0:1782727256.761973:0:5946:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1782727256.762016:0:5946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: 00000000883faa7b/0x14a47870ee88c997 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727256.762029:0:5946:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: 00000000883faa7b/0x14a47870ee88c997 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727256.762040:0:5946:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: 00000000883faa7b/0x14a47870ee88c997 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727256.762062:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000e240be91 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939693440:0@lo:101: 00000100:00100000:0.0:1782727256.762129:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727256.762172:0:5946:0:(client.c:2701:ptlrpc_set_wait()) set 0000000061a70169 going to sleep for 11 seconds 00000100:00100000:0.0:1782727256.762191:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939693440 00000100:00100000:0.0:1782727256.762198:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939693440 00000100:00100000:0.0:1782727256.762241:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1782727256.762249:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003f758509 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+11:5946:x1869324939693440:12345-0@lo:101: 00010000:00010000:0.0:1782727256.762272:0:5942:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727256.762294:0:5942:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005b9edc03/0x14a47870ee88c99e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x14a47870ee88c997 expref: -99 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727256.762315:0:5942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005b9edc03/0x14a47870ee88c99e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x14a47870ee88c997 expref: 12 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727256.762325:0:5942:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005b9edc03/0x14a47870ee88c99e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x14a47870ee88c997 expref: 12 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727256.762332:0:5942:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005b9edc03, rc 0) 00000100:00100000:0.0:1782727256.762367:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003f758509 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+12:5946:x1869324939693440:12345-0@lo:101: Request processed in 119us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727256.762373:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1782727256.762418:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000e240be91 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939693440:0@lo:101: 00010000:00010000:0.0:1782727256.762430:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: 00000000883faa7b/0x14a47870ee88c997 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88c99e expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727256.762438:0:5946:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: 00000000883faa7b/0x14a47870ee88c997 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x14a47870ee88c99e expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727256.762482:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000e240be91 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939693568:0@lo:256: 00000100:00100000:0.0:1782727256.762509:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727256.762522:0:5946:0:(client.c:2701:ptlrpc_set_wait()) set 0000000061a70169 going to sleep for 11 seconds 00000100:00100000:0.0:1782727256.762534:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939693568 00000100:00100000:0.0:1782727256.762537:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939693568 00000100:00100000:0.0:1782727256.762572:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1782727256.762578:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000527f8a29 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+12:5946:x1869324939693568:12345-0@lo:256: 20000000:01000000:0.0:1782727256.762598:0:5944:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1782727256.762611:0:5944:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1782727256.762614:0:5944:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1782727256.762685:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000527f8a29 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+12:5946:x1869324939693568:12345-0@lo:256: Request processed in 106us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727256.762692:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1782727256.762721:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000e240be91 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939693568:0@lo:256: 10000000:01000000:0.0:1782727256.762756:0:5946:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1782727256.762761:0:5946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: 00000000883faa7b/0x14a47870ee88c997 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88c99e expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727256.762769:0:5946:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: 00000000883faa7b/0x14a47870ee88c997 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88c99e expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727257.530712:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727258.553871:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727259.577510:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1782727259.599146:0:6381:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1782727259.599645:0:6381:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1782727260.606540:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727260.857173:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000261eefb0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3442:1869324939693824:0@lo:400: 00000100:00100000:0.0:1782727260.857229:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727260.857309:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000e240be91 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c71e9f0f-6441-4b9b-bc96-153ab9250801:3445:1869324939693696:0@lo:400: 00000100:00100000:3.0:1782727260.857334:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727260.857368:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939693824 00000100:00100000:3.0:1782727260.857374:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939693824 00000100:00100000:3.0:1782727260.857408:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782727260.857413:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000054c2ed3f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1869324939693824:12345-0@lo:400: 00000100:00100000:3.0:1782727260.857449:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000054c2ed3f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1869324939693824:12345-0@lo:400: Request processed in 37us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727260.857454:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1782727260.857486:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000261eefb0 x1869324939693824/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727260.857496:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000261eefb0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3442:1869324939693824:0@lo:400: 00000100:00100000:0.0:1782727260.857664:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939693696 00000100:00100000:0.0:1782727260.857668:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939693696 00000100:00100000:0.0:1782727260.857813:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1782727260.857820:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005f41ed10 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+12:3445:x1869324939693696:12345-0@lo:400: 00000100:00100000:0.0:1782727260.857941:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005f41ed10 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+12:3445:x1869324939693696:12345-0@lo:400: Request processed in 121us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727260.857947:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1782727260.858192:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000e240be91 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c71e9f0f-6441-4b9b-bc96-153ab9250801:3445:1869324939693696:0@lo:400: 00000020:00000080:3.0:1782727260.979850:0:6430:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffdaa53ee0 20000000:00000080:3.0:1782727260.979868:0:6430:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff921c76530000 uarg=0000000000000000 20000000:01000000:3.0:1782727260.979942:0:6430:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1782727260.979949:0:6430:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1782727260.979954:0:6430:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1782727260.980020:0:6430:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1782727260.980030:0:6430:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1782727260.986167:0:6430:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782727260.986426:0:6430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1782727260.986459:0:6430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1782727260.986493:0:6430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1782727260.986522:0:6430:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1782727260.986539:0:6430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000aaf353ef/0x14a47870ee88c9a5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727260.986562:0:6430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000d31816c0/0x14a47870ee88c966 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x14a47870ee88c95f expref: 11 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727260.986570:0:6430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000aaf353ef/0x14a47870ee88c9a5 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727260.986612:0:6430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000d31816c0/0x14a47870ee88c966 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x14a47870ee88c95f expref: 11 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727260.986624:0:6430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000d31816c0/0x14a47870ee88c966 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x14a47870ee88c95f expref: 11 pid: 5944 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727260.986637:0:6430:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000cb735120 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6430:1869324939693952:0@lo:104: 00000100:00100000:2.0:1782727260.986721:0:6430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727260.986831:0:6430:0:(client.c:2701:ptlrpc_set_wait()) set 000000005d6b9440 going to sleep for 11 seconds 00000100:00100000:2.0:1782727260.987540:0:5933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939693952 00000100:00100000:2.0:1782727260.987548:0:5933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939693952 00000100:00100000:2.0:1782727260.987630:0:5933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782727260.987639:0:5933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000045817a0a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c71e9f0f-6441-4b9b-bc96-153ab9250801+3:6430:x1869324939693952:12345-0@lo:104: 00010000:00010000:2.0:1782727260.987651:0:5933:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.160@tcp lock: 00000000d0cdb029/0x14a47870ee88c95f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x14a47870ee88c966 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727260.987731:0:5933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782727260.987737:0:5933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000045817a0a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c71e9f0f-6441-4b9b-bc96-153ab9250801+3:6430:x1869324939693952:12345-0@lo:104: Request processed in 100us (1018us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727260.987744:0:5933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782727260.987818:0:6430:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000cb735120 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6430:1869324939693952:0@lo:104: 00010000:00010000:3.0:1782727260.987838:0:6430:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000aaf353ef/0x14a47870ee88c9a5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727260.987863:0:5938:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782727260.987869:0:5938:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: 00000000d0cdb029/0x14a47870ee88c95f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x14a47870ee88c966 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727260.987904:0:5938:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d0cdb029 already unused, calling callback (000000000d1db875) 10000000:00010000:0.0:1782727260.987908:0:5938:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: 00000000d0cdb029/0x14a47870ee88c95f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x14a47870ee88c966 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727260.987914:0:5938:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: 00000000d0cdb029/0x14a47870ee88c95f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x14a47870ee88c966 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782727260.987920:0:5938:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: 00000000d0cdb029/0x14a47870ee88c95f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x14a47870ee88c966 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782727260.987925:0:5938:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1782727260.987956:0:5938:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: 00000000d0cdb029/0x14a47870ee88c95f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x14a47870ee88c966 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727260.987965:0:5938:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782727260.987982:0:5938:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: 00000000d0cdb029/0x14a47870ee88c95f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x14a47870ee88c966 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727260.987989:0:5938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: 00000000d0cdb029/0x14a47870ee88c95f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x14a47870ee88c966 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727260.988003:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727260.988006:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727260.988007:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727260.988019:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d2a7dcf0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c71e9f0f-6441-4b9b-bc96-153ab9250801:3443:1869324939694080:0@lo:103: 00000100:00100000:0.0:1782727260.988065:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727260.988117:0:5934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939694080 00000100:00100000:0.0:1782727260.988121:0:5934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939694080 00010000:00010000:0.0:1782727260.988139:0:5934:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000d31816c0/0x14a47870ee88c966 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x14a47870ee88c95f expref: 12 pid: 5944 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727260.988170:0:5934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782727260.988177:0:5934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000b39c376 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c71e9f0f-6441-4b9b-bc96-153ab9250801+12:3443:x1869324939694080:12345-0@lo:103: 00010000:00010000:0.0:1782727260.988187:0:5934:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782727260.988192:0:5934:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000d31816c0/0x14a47870ee88c966 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x14a47870ee88c95f expref: 12 pid: 5944 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727260.988203:0:5934:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000d31816c0/0x14a47870ee88c966 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x14a47870ee88c95f expref: 12 pid: 5944 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727260.988217:0:5934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d31816c0/0x14a47870ee88c966 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x14a47870ee88c95f expref: 12 pid: 5944 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727260.988230:0:5934:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000aaf353ef/0x14a47870ee88c9a5 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727260.988236:0:5934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000aaf353ef/0x14a47870ee88c9a5 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727260.988247:0:5934:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000aaf353ef/0x14a47870ee88c9a5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727260.988253:0:5934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000aaf353ef/0x14a47870ee88c9a5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727260.988258:0:5934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000aaf353ef/0x14a47870ee88c9a5 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727260.988264:0:5934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000aaf353ef/0x14a47870ee88c9a5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727260.988278:0:5934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000aaf353ef already unused, calling callback (0000000073239827) 00010000:00010000:0.0:1782727260.988281:0:5934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000aaf353ef/0x14a47870ee88c9a5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727260.988287:0:5934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000aaf353ef/0x14a47870ee88c9a5 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727260.988306:0:5934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000aaf353ef/0x14a47870ee88c9a5 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727260.988315:0:5934:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782727260.988341:0:5934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000b39c376 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c71e9f0f-6441-4b9b-bc96-153ab9250801+11:3443:x1869324939694080:12345-0@lo:103: Request processed in 166us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727260.988347:0:5934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782727260.988373:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d2a7dcf0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c71e9f0f-6441-4b9b-bc96-153ab9250801:3443:1869324939694080:0@lo:103: 00010000:00010000:3.0:1782727260.989069:0:6430:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000aaf353ef/0x14a47870ee88c9a5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727260.989080:0:6430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000aaf353ef/0x14a47870ee88c9a5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727260.989086:0:6430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000aaf353ef/0x14a47870ee88c9a5 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727261.628481:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727262.650347:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727263.677266:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727264.719289:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1782727265.467778:0:5946:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1782727265.467785:0:5946:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff921c479c5800 from 1 10000000:01000000:3.0:1782727265.467790:0:5946:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782727265.467833:0:5946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: 00000000e0d69093/0x14a47870ee88c9ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727265.467845:0:5946:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: 00000000e0d69093/0x14a47870ee88c9ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727265.467856:0:5946:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: 00000000e0d69093/0x14a47870ee88c9ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727265.467879:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000002777f2e4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939694208:0@lo:101: 00000100:00100000:3.0:1782727265.467967:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727265.468007:0:5946:0:(client.c:2701:ptlrpc_set_wait()) set 00000000ab9490d2 going to sleep for 11 seconds 00000100:00100000:3.0:1782727265.468027:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939694208 00000100:00100000:3.0:1782727265.468033:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939694208 00000100:00100000:3.0:1782727265.468075:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1782727265.468082:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000022affb08 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+11:5946:x1869324939694208:12345-0@lo:101: 00010000:00010000:3.0:1782727265.468110:0:5942:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727265.468121:0:5942:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000094e6589d/0x14a47870ee88c9b3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x14a47870ee88c9ac expref: -99 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727265.468141:0:5942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000094e6589d/0x14a47870ee88c9b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x14a47870ee88c9ac expref: 12 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727265.468150:0:5942:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000094e6589d/0x14a47870ee88c9b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x14a47870ee88c9ac expref: 12 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727265.468158:0:5942:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000094e6589d, rc 0) 00000100:00100000:3.0:1782727265.468188:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000022affb08 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+12:5946:x1869324939694208:12345-0@lo:101: Request processed in 107us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727265.468194:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1782727265.468254:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000002777f2e4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939694208:0@lo:101: 00010000:00010000:3.0:1782727265.468264:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: 00000000e0d69093/0x14a47870ee88c9ac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88c9b3 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727265.468272:0:5946:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: 00000000e0d69093/0x14a47870ee88c9ac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x14a47870ee88c9b3 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727265.468321:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000002777f2e4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939694336:0@lo:501: 00000100:00100000:3.0:1782727265.468340:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727265.468350:0:5946:0:(client.c:2701:ptlrpc_set_wait()) set 00000000ab9490d2 going to sleep for 11 seconds 00000100:00100000:3.0:1782727265.468361:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939694336 00000100:00100000:3.0:1782727265.468364:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939694336 00000100:00100000:3.0:1782727265.468381:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1782727265.468385:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003b2cb4fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+12:5946:x1869324939694336:12345-0@lo:501: 00000100:00100000:3.0:1782727265.468497:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003b2cb4fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+12:5946:x1869324939694336:12345-0@lo:501: Request processed in 111us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727265.468503:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1782727265.468527:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000002777f2e4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939694336:0@lo:501: 00000100:00100000:3.0:1782727265.468548:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000002777f2e4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939694464:0@lo:503: 00000100:00100000:3.0:1782727265.468581:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727265.468591:0:5946:0:(client.c:2701:ptlrpc_set_wait()) set 00000000ab9490d2 going to sleep for 11 seconds 00000100:00100000:3.0:1782727265.468601:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939694464 00000100:00100000:3.0:1782727265.468604:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939694464 00000100:00100000:3.0:1782727265.468620:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1782727265.468625:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000084bf8c61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+12:5946:x1869324939694464:12345-0@lo:503: 00000100:00100000:3.0:1782727265.468688:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000084bf8c61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+12:5946:x1869324939694464:12345-0@lo:503: Request processed in 63us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727265.468694:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1782727265.468725:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000002777f2e4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939694464:0@lo:503: 00000100:00100000:3.0:1782727265.469020:0:6645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000002777f2e4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c71e9f0f-6441-4b9b-bc96-153ab9250801:6645:1869324939694592:0@lo:502: 00000100:00100000:3.0:1782727265.469050:0:6645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727265.469066:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939694592 00000100:00100000:3.0:1782727265.469069:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939694592 00000100:00100000:3.0:1782727265.469086:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1782727265.469091:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000022e475dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+12:6645:x1869324939694592:12345-0@lo:502: 00000100:00100000:3.0:1782727265.469149:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000022e475dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+12:6645:x1869324939694592:12345-0@lo:502: Request processed in 58us (99us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727265.469156:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1782727265.469181:0:6645:0:(client.c:2701:ptlrpc_set_wait()) set 000000006881307b going to sleep for 11 seconds 00000100:00100000:3.0:1782727265.469193:0:6645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000002777f2e4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c71e9f0f-6441-4b9b-bc96-153ab9250801:6645:1869324939694592:0@lo:502: 00000020:01000000:3.0:1782727265.469212:0:6645:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782727265.469219:0:6645:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782727265.469221:0:6645:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1782727265.469228:0:6645:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff921c479c5800 00000020:00000080:3.0:1782727265.469230:0:6645:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1782727265.469262:0:6645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e46680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c71e9f0f-6441-4b9b-bc96-153ab9250801:6645:1869324939694720:0@lo:502: 00000100:00100000:3.0:1782727265.469288:0:6645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727265.469302:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939694720 00000100:00100000:3.0:1782727265.469305:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939694720 00000100:00100000:3.0:1782727265.469322:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1782727265.469327:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fd13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+12:6645:x1869324939694720:12345-0@lo:502: 00000100:00100000:3.0:1782727265.469373:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fd13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+12:6645:x1869324939694720:12345-0@lo:502: Request processed in 45us (84us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727265.469378:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1782727265.469401:0:6645:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c66f89840 going to sleep for 11 seconds 00000100:00100000:3.0:1782727265.469410:0:6645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e46680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c71e9f0f-6441-4b9b-bc96-153ab9250801:6645:1869324939694720:0@lo:502: 00000020:01000000:3.0:1782727265.469424:0:6645:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782727265.469428:0:6645:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782727265.469429:0:6645:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1782727265.469432:0:6645:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1782727265.469487:0:5946:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1782727265.469503:0:5946:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782727265.469510:0:5946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff921c4151da00/0x14a47870ee88c9ac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88c9b3 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727265.469518:0:5946:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff921c4151da00/0x14a47870ee88c9ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88c9b3 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727265.721206:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727265.978958:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c76440380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869324939694848:0@lo:400: 00000100:00100000:2.0:1782727265.979047:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727265.979280:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939694848 00000100:00100000:2.0:1782727265.979288:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939694848 00000100:00100000:2.0:1782727265.979330:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782727265.979339:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c45e42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869324939694848:12345-0@lo:400: 00000100:00100000:2.0:1782727265.979392:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c45e42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869324939694848:12345-0@lo:400: Request processed in 53us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727265.979398:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1782727265.979787:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff921c76440380 x1869324939694848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727281 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727265.979800:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c76440380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869324939694848:0@lo:400: 00010000:00010000:0.0:1782727266.745087:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727267.769278:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727268.793140:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727269.819453:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727270.842008:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727271.098150:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3442:1869324939695104:0@lo:400: 00000100:00100000:3.0:1782727271.098219:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727271.098289:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939695104 00000100:00100000:3.0:1782727271.098296:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939695104 00000100:00100000:3.0:1782727271.098340:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782727271.098348:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c45e47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1869324939695104:12345-0@lo:400: 00000100:00100000:3.0:1782727271.098398:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c45e47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1869324939695104:12345-0@lo:400: Request processed in 51us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727271.098405:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1782727271.098459:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff921c45e45180 x1869324939695104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727271.098473:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3442:1869324939695104:0@lo:400: 00000100:00100000:0.0:1782727271.098606:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c71e9f0f-6441-4b9b-bc96-153ab9250801:3445:1869324939694976:0@lo:400: 00000100:00100000:0.0:1782727271.098652:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727271.098861:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939694976 00000100:00100000:3.0:1782727271.098866:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939694976 00000100:00100000:3.0:1782727271.098920:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1782727271.098928:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fd10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+12:3445:x1869324939694976:12345-0@lo:400: 00000100:00100000:3.0:1782727271.098963:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fd10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+12:3445:x1869324939694976:12345-0@lo:400: Request processed in 35us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727271.098970:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1782727271.099080:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c71e9f0f-6441-4b9b-bc96-153ab9250801:3445:1869324939694976:0@lo:400: 00000020:01000004:3.0:1782727271.163644:0:6942:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:3.0:1782727271.163648:0:6942:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1782727271.163649:0:6942:0:(obd_mount.c:920:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1782727271.163776:0:6942:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff921c45e6f800 00000020:01000004:3.0:1782727271.163792:0:6942:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1782727271.163802:0:6942:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1782727271.163823:0:6942:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff921c7656b3a0) 00000020:00000080:3.0:1782727271.163841:0:6942:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1782727271.216810:0:6942:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1782727271.216954:0:6942:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:2.0:1782727271.238274:0:6942:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1782727271.238506:0:6942:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1782727271.238521:0:6942:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:2.0:1782727271.238535:0:6942:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x14a47870ee88c9c1 00000020:01000004:2.0:1782727271.238544:0:6942:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1782727271.238566:0:6942:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.202.160@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1782727271.238569:0:6942:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.160@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1782727271.238576:0:6942:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1782727271.238580:0:6942:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1782727271.238592:0:6942:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff921c431b19d0) 00000020:00000080:2.0:1782727271.238601:0:6942:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1782727271.243909:0:6942:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782727271.244075:0:6942:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1782727271.244081:0:6942:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1782727271.247310:0:6942:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1782727271.247322:0:6942:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1782727271.248105:0:6942:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1782727271.248111:0:6942:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1782727271.253079:0:6942:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782727271.253256:0:6942:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1782727271.253269:0:6942:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1782727271.259465:0:6942:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1782727271.259480:0:6942:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1782727271.280265:0:6942:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782727271.280480:0:6942:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1782727271.280486:0:6942:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1782727271.282654:0:6942:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1782727271.282666:0:6942:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1782727271.283931:0:6942:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1782727271.283941:0:6942:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1782727271.286376:0:6942:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782727271.286583:0:6942:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1782727271.286589:0:6942:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1782727271.287278:0:6942:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1782727271.287286:0:6942:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1782727271.328562:0:6942:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782727271.328776:0:6942:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1782727271.328782:0:6942:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1782727271.330274:0:6942:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1782727271.330285:0:6942:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1782727271.330732:0:6942:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1782727271.330758:0:6942:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1782727271.330764:0:6942:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.160@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1782727271.348387:0:6942:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.160@tcp ctxt 0 is initialized 00000020:01000004:2.0:1782727271.348436:0:6942:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.160@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1782727271.348439:0:6942:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1782727271.348443:0:6942:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1782727271.348444:0:6942:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782727271.348445:0:6942:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782727271.348446:0:6942:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782727271.348447:0:6942:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782727271.348448:0:6942:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782727271.348449:0:6942:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1782727271.348450:0:6942:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1782727271.348451:0:6942:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782727271.348452:0:6942:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1782727271.348454:0:6942:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1782727271.348456:0:6942:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1782727271.348456:0:6942:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1782727271.348457:0:6942:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782727271.348458:0:6942:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782727271.348458:0:6942:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782727271.348459:0:6942:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782727271.348460:0:6942:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782727271.348460:0:6942:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1782727271.348461:0:6942:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1782727271.348461:0:6942:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782727271.348462:0:6942:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1782727271.349325:0:6942:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1782727271.349349:0:6942:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e41180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:6942:1869324939695232:0@lo:253: 00000100:00100000:2.0:1782727271.349443:0:6942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727271.349503:0:6942:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c804a7a80 going to sleep for 11 seconds 00000100:00100000:3.0:1782727271.349511:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939695232 00000100:00100000:3.0:1782727271.349517:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939695232 00000100:00100000:3.0:1782727271.349577:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1782727271.349585:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fd12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+12:6942:x1869324939695232:12345-0@lo:253: 20000000:01000000:3.0:1782727271.349616:0:5942:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1782727271.349620:0:5942:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1782727271.349626:0:5942:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1782727271.349629:0:5942:0:(mgs_llog.c:3853:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1782727271.349855:0:5942:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782727271.350012:0:5942:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1782727271.350027:0:5942:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1782727271.350043:0:5942:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:3.0:1782727271.350050:0:5942:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1782727271.350062:0:5942:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:3.0:1782727271.350077:0:5942:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:3.0:1782727271.350167:0:5942:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1782727271.350180:0:5942:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.202.160@tcp 20000000:01000000:3.0:1782727271.350181:0:5942:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.202.160@tcp (null) (null) (null) 00000040:00080000:3.0:1782727271.350190:0:5942:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1782727271.350193:0:5942:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1782727271.350201:0:5942:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1782727271.350204:0:5942:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.160@tcp (null) (null) 00000040:00080000:3.0:1782727271.350210:0:5942:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1782727271.350214:0:5942:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1782727271.350220:0:5942:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1782727271.350229:0:5942:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:3.0:1782727271.350560:0:5942:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1782727271.350568:0:5942:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.202.160@tcp 20000000:01000000:3.0:1782727271.350574:0:5942:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.202.160@tcp (null) (null) (null) 00000040:00080000:3.0:1782727271.350584:0:5942:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1782727271.350588:0:5942:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1782727271.350603:0:5942:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1782727271.350606:0:5942:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.160@tcp (null) (null) 00000040:00080000:3.0:1782727271.350620:0:5942:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1782727271.350626:0:5942:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1782727271.350637:0:5942:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:3.0:1782727271.350651:0:5942:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:3.0:1782727271.350664:0:5942:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1782727271.350666:0:5942:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1782727271.350670:0:5942:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1782727271.350711:0:5942:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1782727271.350713:0:5942:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1782727271.351211:0:6961:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:3.0:1782727271.351230:0:6961:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:3.0:1782727271.351242:0:6961:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1782727271.351389:0:5942:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1782727271.351432:0:5942:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1782727271.351449:0:5942:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1782727271.351456:0:5942:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1782727271.351458:0:5942:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1782727271.351733:0:6962:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1782727271.351745:0:6962:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1782727271.351753:0:6962:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1782727271.351831:0:5942:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:3.0:1782727271.351843:0:5942:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:3.0:1782727271.351852:0:5942:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:3.0:1782727271.351860:0:5942:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1782727271.351861:0:5942:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1782727271.352269:0:6963:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1782727271.352465:0:5942:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:3.0:1782727271.352485:0:5942:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:3.0:1782727271.352498:0:5942:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 10000000:01000000:3.0:1782727271.352511:0:5942:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1782727271.352528:0:5942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff921c4151d200/0x14a47870ee88c9cf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727271.352544:0:5942:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff921c8215f400/0x14a47870ee88c8e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x14a47870ee88c8e1 expref: 12 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727271.352552:0:5942:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff921c8215e000/0x14a47870ee88c904 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x14a47870ee88c8fd expref: 12 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727271.352565:0:5942:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff921c8215fe00/0x14a47870ee88c974 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x14a47870ee88c96d expref: 12 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727271.352573:0:5942:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff921c4151d200/0x14a47870ee88c9cf lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727271.352608:0:5942:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff921c8215fe00/0x14a47870ee88c974 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x14a47870ee88c96d expref: 12 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727271.352622:0:5942:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff921c8215fe00/0x14a47870ee88c974 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x14a47870ee88c96d expref: 12 pid: 5944 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727271.352635:0:5942:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e45180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5942:1869324939695360:0@lo:104: 00000100:00100000:3.0:1782727271.352693:0:5942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782727271.352775:0:5942:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff921c8215e000/0x14a47870ee88c904 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x14a47870ee88c8fd expref: 12 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727271.352784:0:5942:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff921c8215e000/0x14a47870ee88c904 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x14a47870ee88c8fd expref: 12 pid: 5944 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727271.352791:0:5942:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e44a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5942:1869324939695488:0@lo:104: 00000100:00100000:3.0:1782727271.352813:0:5942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782727271.352918:0:5942:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff921c8215f400/0x14a47870ee88c8e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x14a47870ee88c8e1 expref: 12 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727271.352926:0:5942:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff921c8215f400/0x14a47870ee88c8e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x14a47870ee88c8e1 expref: 12 pid: 5943 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727271.352935:0:5942:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e47800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5942:1869324939695616:0@lo:104: 00000100:00100000:3.0:1782727271.352971:0:5942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727271.353054:0:5933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939695360 00000100:00100000:2.0:1782727271.353062:0:5933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939695360 00000100:00100000:2.0:1782727271.353103:0:5933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939695488 00000100:00100000:2.0:1782727271.353107:0:5933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939695488 00000100:00100000:2.0:1782727271.353122:0:5933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782727271.353131:0:5933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c45e46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c71e9f0f-6441-4b9b-bc96-153ab9250801+4:5942:x1869324939695360:12345-0@lo:104: 00010000:00010000:2.0:1782727271.353142:0:5933:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.160@tcp lock: ffff921c43a23600/0x14a47870ee88c96d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x14a47870ee88c974 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727271.353188:0:5933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782727271.353199:0:5933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c45e46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c71e9f0f-6441-4b9b-bc96-153ab9250801+4:5942:x1869324939695360:12345-0@lo:104: Request processed in 70us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727271.353207:0:5933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782727271.353224:0:5933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782727271.353229:0:5933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c45e44e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c71e9f0f-6441-4b9b-bc96-153ab9250801+3:5942:x1869324939695488:12345-0@lo:104: 00010000:00010000:2.0:1782727271.353236:0:5933:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.160@tcp lock: ffff921c4151ca00/0x14a47870ee88c8fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x14a47870ee88c904 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727271.353269:0:5933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1782727271.353274:0:5933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c45e44e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c71e9f0f-6441-4b9b-bc96-153ab9250801+3:5942:x1869324939695488:12345-0@lo:104: Request processed in 45us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727271.353280:0:5933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1782727271.353353:0:5937:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782727271.353359:0:5937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff921c43a23600/0x14a47870ee88c96d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x14a47870ee88c974 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727271.353368:0:5937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c43a23600 already unused, calling callback (ffffffffc12b0c20) 10000000:00010000:1.0:1782727271.353372:0:5937:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff921c43a23600/0x14a47870ee88c96d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x14a47870ee88c974 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727271.353380:0:5937:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff921c43a23600/0x14a47870ee88c96d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x14a47870ee88c974 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782727271.353388:0:5937:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff921c43a23600/0x14a47870ee88c96d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x14a47870ee88c974 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782727271.353393:0:5937:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782727271.353439:0:5937:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff921c43a23600/0x14a47870ee88c96d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x14a47870ee88c974 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727271.353446:0:5937:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782727271.353470:0:5937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff921c43a23600/0x14a47870ee88c96d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x14a47870ee88c974 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727271.353476:0:5937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff921c43a23600/0x14a47870ee88c96d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x14a47870ee88c974 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727271.353488:0:5937:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782727271.353491:0:5937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff921c4151ca00/0x14a47870ee88c8fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x14a47870ee88c904 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727271.353497:0:5937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c4151ca00 already unused, calling callback (ffffffffc12b0c20) 10000000:00010000:1.0:1782727271.353500:0:5937:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff921c4151ca00/0x14a47870ee88c8fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x14a47870ee88c904 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727271.353506:0:5937:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff921c4151ca00/0x14a47870ee88c8fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x14a47870ee88c904 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782727271.353512:0:5937:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff921c4151ca00/0x14a47870ee88c8fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x14a47870ee88c904 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782727271.353517:0:5937:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782727271.353530:0:5937:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff921c4151ca00/0x14a47870ee88c8fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x14a47870ee88c904 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727271.353536:0:5937:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782727271.353548:0:5937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff921c4151ca00/0x14a47870ee88c8fd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x14a47870ee88c904 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727271.353555:0:5937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff921c4151ca00/0x14a47870ee88c8fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x14a47870ee88c904 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727271.353562:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727271.353570:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727271.353572:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727271.353753:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c6e381880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c71e9f0f-6441-4b9b-bc96-153ab9250801:3444:1869324939695872:0@lo:103: 00000100:00100000:2.0:1782727271.353784:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727271.353863:0:5934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939695872 00000100:00100000:1.0:1782727271.353868:0:5934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939695872 00010000:00010000:1.0:1782727271.353921:0:5934:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff921c8215e000/0x14a47870ee88c904 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x14a47870ee88c8fd expref: 13 pid: 5944 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727271.353945:0:5934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782727271.353952:0:5934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c45e43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c71e9f0f-6441-4b9b-bc96-153ab9250801+13:3444:x1869324939695872:12345-0@lo:103: 00010000:00010000:1.0:1782727271.353962:0:5934:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782727271.353967:0:5934:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff921c8215e000/0x14a47870ee88c904 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x14a47870ee88c8fd expref: 13 pid: 5944 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727271.353976:0:5934:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff921c8215e000/0x14a47870ee88c904 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x14a47870ee88c8fd expref: 13 pid: 5944 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727271.353990:0:5934:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782727271.354018:0:5934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c45e43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c71e9f0f-6441-4b9b-bc96-153ab9250801+13:3444:x1869324939695872:12345-0@lo:103: Request processed in 66us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727271.354024:0:5934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782727271.354108:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c6e381880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c71e9f0f-6441-4b9b-bc96-153ab9250801:3444:1869324939695872:0@lo:103: 00000100:00100000:3.0:1782727271.354279:0:5942:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c6dc1d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782727271.354304:0:5942:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e45180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5942:1869324939695360:0@lo:104: 00010000:00010000:3.0:1782727271.354312:0:5942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921c8215e000/0x14a47870ee88c904 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x14a47870ee88c8fd expref: 12 pid: 5944 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727271.354324:0:5942:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e44a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5942:1869324939695488:0@lo:104: 00000100:00100000:3.0:1782727271.354338:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c6e380000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c71e9f0f-6441-4b9b-bc96-153ab9250801:3443:1869324939695744:0@lo:103: 00000100:00100000:3.0:1782727271.354362:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727271.354509:0:5932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939695616 00000100:00100000:0.0:1782727271.354514:0:5932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939695616 00000100:00100000:1.0:1782727271.354554:0:5936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939695744 00000100:00100000:1.0:1782727271.354558:0:5936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939695744 00010000:00010000:1.0:1782727271.354572:0:5936:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff921c8215fe00/0x14a47870ee88c974 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x14a47870ee88c96d expref: 12 pid: 5944 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727271.354598:0:5936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782727271.354605:0:5936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c45e46d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c71e9f0f-6441-4b9b-bc96-153ab9250801+12:3443:x1869324939695744:12345-0@lo:103: 00010000:00010000:1.0:1782727271.354614:0:5936:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782727271.354618:0:5936:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff921c8215fe00/0x14a47870ee88c974 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x14a47870ee88c96d expref: 12 pid: 5944 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727271.354639:0:5936:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff921c8215fe00/0x14a47870ee88c974 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x14a47870ee88c96d expref: 12 pid: 5944 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727271.354648:0:5936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921c8215fe00/0x14a47870ee88c974 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x14a47870ee88c96d expref: 12 pid: 5944 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727271.354658:0:5936:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782727271.354684:0:5936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c45e46d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c71e9f0f-6441-4b9b-bc96-153ab9250801+11:3443:x1869324939695744:12345-0@lo:103: Request processed in 79us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727271.354690:0:5936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782727271.354741:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c6e380000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c71e9f0f-6441-4b9b-bc96-153ab9250801:3443:1869324939695744:0@lo:103: 00000100:00100000:2.0:1782727271.354781:0:5933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782727271.354788:0:5933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c45e46a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c71e9f0f-6441-4b9b-bc96-153ab9250801+3:5942:x1869324939695616:12345-0@lo:104: 00010000:00010000:2.0:1782727271.354796:0:5933:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.160@tcp lock: ffff921c43a23c00/0x14a47870ee88c8e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x14a47870ee88c8e8 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727271.354838:0:5933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782727271.354843:0:5933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c45e46a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c71e9f0f-6441-4b9b-bc96-153ab9250801+3:5942:x1869324939695616:12345-0@lo:104: Request processed in 57us (1873us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727271.354849:0:5933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1782727271.354922:0:5942:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e47800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5942:1869324939695616:0@lo:104: 00010000:00010000:3.0:1782727271.354941:0:5942:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff921c4151d200/0x14a47870ee88c9cf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727271.354990:0:5937:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782727271.354996:0:5937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff921c43a23c00/0x14a47870ee88c8e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x14a47870ee88c8e8 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727271.355003:0:5937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c43a23c00 already unused, calling callback (ffffffffc12b0c20) 10000000:00010000:1.0:1782727271.355007:0:5937:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff921c43a23c00/0x14a47870ee88c8e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x14a47870ee88c8e8 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727271.355014:0:5937:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff921c43a23c00/0x14a47870ee88c8e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x14a47870ee88c8e8 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782727271.355022:0:5937:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff921c43a23c00/0x14a47870ee88c8e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x14a47870ee88c8e8 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782727271.355027:0:5937:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782727271.355053:0:5937:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff921c43a23c00/0x14a47870ee88c8e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x14a47870ee88c8e8 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727271.355059:0:5937:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782727271.355086:0:5937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff921c43a23c00/0x14a47870ee88c8e1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x14a47870ee88c8e8 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727271.355154:0:5937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff921c43a23c00/0x14a47870ee88c8e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x14a47870ee88c8e8 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727271.355166:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727271.355168:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727271.355169:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727271.355195:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782727271.355204:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c6e381500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c71e9f0f-6441-4b9b-bc96-153ab9250801:3444:1869324939696000:0@lo:103: 00000100:00100000:3.0:1782727271.355227:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727271.355393:0:5936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939696000 00000100:00100000:1.0:1782727271.355397:0:5936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939696000 00010000:00010000:1.0:1782727271.355410:0:5936:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff921c8215f400/0x14a47870ee88c8e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x14a47870ee88c8e1 expref: 11 pid: 5943 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727271.355440:0:5936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782727271.355446:0:5936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c45e47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c71e9f0f-6441-4b9b-bc96-153ab9250801+11:3444:x1869324939696000:12345-0@lo:103: 00010000:00010000:1.0:1782727271.355454:0:5936:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782727271.355458:0:5936:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff921c8215f400/0x14a47870ee88c8e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x14a47870ee88c8e1 expref: 11 pid: 5943 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727271.355466:0:5936:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff921c8215f400/0x14a47870ee88c8e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x14a47870ee88c8e1 expref: 11 pid: 5943 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727271.355475:0:5936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921c8215f400/0x14a47870ee88c8e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x14a47870ee88c8e1 expref: 11 pid: 5943 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727271.355485:0:5936:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff921c4151d200/0x14a47870ee88c9cf lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727271.355493:0:5936:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921c4151d200/0x14a47870ee88c9cf lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727271.355517:0:5936:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff921c4151d200/0x14a47870ee88c9cf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727271.355524:0:5936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff921c4151d200/0x14a47870ee88c9cf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727271.355531:0:5936:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff921c4151d200/0x14a47870ee88c9cf lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727271.355537:0:5936:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff921c4151d200/0x14a47870ee88c9cf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727271.355542:0:5936:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c4151d200 already unused, calling callback (ffffffffc0c98cf0) 00010000:00010000:1.0:1782727271.355545:0:5936:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff921c4151d200/0x14a47870ee88c9cf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727271.355550:0:5936:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff921c4151d200/0x14a47870ee88c9cf lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727271.355565:0:5936:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff921c4151d200/0x14a47870ee88c9cf lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727271.355572:0:5936:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782727271.355591:0:5936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c45e47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c71e9f0f-6441-4b9b-bc96-153ab9250801+10:3444:x1869324939696000:12345-0@lo:103: Request processed in 146us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727271.355595:0:5936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1782727271.355643:0:5942:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff921c4151d200/0x14a47870ee88c9cf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727271.355661:0:5942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff921c4151d200/0x14a47870ee88c9cf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727271.355667:0:5942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921c4151d200/0x14a47870ee88c9cf lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1782727271.355679:0:5942:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1782727271.356173:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c6e381500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c71e9f0f-6441-4b9b-bc96-153ab9250801:3444:1869324939696000:0@lo:103: 00010000:00010000:1.0:1782727271.356251:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727271.357718:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fd12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+9:6942:x1869324939695232:12345-0@lo:253: Request processed in 8128us (8269us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727271.357730:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1782727271.357797:0:6942:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e41180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:6942:1869324939695232:0@lo:253: 10000000:01000000:0.0:1782727271.357811:0:6942:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1782727271.357814:0:6942:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1782727271.357816:0:6942:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1782727271.357817:0:6942:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782727271.357818:0:6942:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1782727271.357819:0:6942:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782727271.357821:0:6942:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782727271.357822:0:6942:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782727271.357824:0:6942:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1782727271.357826:0:6942:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782727271.357827:0:6942:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1782727271.357846:0:6942:0:(tgt_mount.c:101:server_register_mount()) register mount ffff921c45e6f800 from lustre-OST0000 10000000:01000000:0.0:1782727271.358252:0:6942:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1782727271.358254:0:6942:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1782727271.358260:0:6942:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff921c519f0000 local copy 10000000:01000000:0.0:1782727271.358263:0:6942:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1782727271.358364:0:6942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff921c7a3e1400/0x14a47870ee88c9d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727271.358382:0:6942:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.160@tcp lock: ffff921c7a3e1400/0x14a47870ee88c9d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727271.358389:0:6942:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff921c7a3e1400/0x14a47870ee88c9d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727271.358402:0:6942:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c76441f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:6942:1869324939696128:0@lo:101: 00000100:00100000:0.0:1782727271.358446:0:6942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727271.358503:0:6942:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c4685fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1782727271.358531:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939696128 00000100:00100000:2.0:1782727271.358535:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939696128 00000100:00100000:2.0:1782727271.358585:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1782727271.358591:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fd13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+9:6942:x1869324939696128:12345-0@lo:101: 00010000:00010000:2.0:1782727271.358601:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727271.358612:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921c429d5e00/0x14a47870ee88c9dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x14a47870ee88c9d6 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727271.358634:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921c429d5e00/0x14a47870ee88c9dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x14a47870ee88c9d6 expref: 10 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727271.358644:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921c429d5e00/0x14a47870ee88c9dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x14a47870ee88c9d6 expref: 10 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727271.358653:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c429d5e00, rc 0) 00000100:00100000:2.0:1782727271.358689:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fd13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+10:6942:x1869324939696128:12345-0@lo:101: Request processed in 97us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727271.358695:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1782727271.358711:0:6942:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c76441f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:6942:1869324939696128:0@lo:101: 00010000:00010000:1.0:1782727271.358723:0:6942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff921c7a3e1400/0x14a47870ee88c9d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x14a47870ee88c9dd expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727271.358736:0:6942:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff921c7a3e1400/0x14a47870ee88c9d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x14a47870ee88c9dd expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727271.358815:0:6942:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c6e382680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:6942:1869324939696256:0@lo:501: 00000100:00100000:1.0:1782727271.358834:0:6942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727271.358850:0:6942:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c66f89000 going to sleep for 11 seconds 00000100:00100000:2.0:1782727271.359018:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939696256 00000100:00100000:2.0:1782727271.359022:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939696256 00000100:00100000:2.0:1782727271.359078:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1782727271.359086:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fd11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+10:6942:x1869324939696256:12345-0@lo:501: 00000100:00100000:2.0:1782727271.359222:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fd11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+10:6942:x1869324939696256:12345-0@lo:501: Request processed in 136us (385us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782727271.359229:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1782727271.359283:0:6942:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c6e382680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:6942:1869324939696256:0@lo:501: 10000000:01000000:1.0:1782727271.359325:0:6942:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.160@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1782727271.359342:0:6942:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.160@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1782727271.359347:0:6942:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff921c7a3e1400/0x14a47870ee88c9d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x14a47870ee88c9dd expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727271.359356:0:6942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff921c7a3e1400/0x14a47870ee88c9d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x14a47870ee88c9dd expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727271.359363:0:6942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.160@tcp lock: ffff921c7a3e1400/0x14a47870ee88c9d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x14a47870ee88c9dd expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727271.359381:0:6942:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1782727271.359401:0:6942:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff921c45e6f800 00010000:00010000:1.0:1782727271.359410:0:5937:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782727271.359427:0:5937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff921c7a3e1400/0x14a47870ee88c9d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x14a47870ee88c9dd expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727271.359436:0:5937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c7a3e1400 already unused, calling callback (ffffffffc12b0c20) 10000000:00010000:1.0:1782727271.359439:0:5937:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff921c7a3e1400/0x14a47870ee88c9d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x14a47870ee88c9dd expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727271.359457:0:5937:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff921c7a3e1400/0x14a47870ee88c9d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x14a47870ee88c9dd expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782727271.359463:0:5937:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff921c7a3e1400/0x14a47870ee88c9d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x14a47870ee88c9dd expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782727271.359468:0:5937:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782727271.359485:0:5937:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff921c7a3e1400/0x14a47870ee88c9d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x14a47870ee88c9dd expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727271.359491:0:5937:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782727271.359505:0:5937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff921c7a3e1400/0x14a47870ee88c9d6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x14a47870ee88c9dd expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727271.359512:0:5937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff921c7a3e1400/0x14a47870ee88c9d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x14a47870ee88c9dd expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727271.359526:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727271.359528:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727271.359529:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1782727271.359538:0:6942:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1782727271.359543:0:6942:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff921c519f0000 10000000:01000000:1.0:1782727271.359546:0:6942:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1782727271.359550:0:6942:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff921c519f0000 from 1 10000000:01000000:1.0:1782727271.359552:0:6942:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782727271.359567:0:6942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff921c43a23600/0x14a47870ee88c9e4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727271.359575:0:6942:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff921c43a23600/0x14a47870ee88c9e4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727271.359592:0:6942:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff921c43a23600/0x14a47870ee88c9e4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727271.359605:0:6942:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c6e381180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:6942:1869324939696512:0@lo:101: 00000100:00100000:1.0:1782727271.359631:0:6942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727271.359742:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c6e382680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c71e9f0f-6441-4b9b-bc96-153ab9250801:3442:1869324939696384:0@lo:103: 00000100:00100000:3.0:1782727271.359772:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727271.359815:0:5936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939696384 00000100:00100000:3.0:1782727271.359819:0:5936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939696384 00000100:00100000:3.0:1782727271.359845:0:5936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782727271.359849:0:5936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c45e44a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c71e9f0f-6441-4b9b-bc96-153ab9250801+10:3442:x1869324939696384:12345-0@lo:103: 00010000:00010000:3.0:1782727271.359867:0:5936:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782727271.359880:0:5936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921c429d5e00/0x14a47870ee88c9dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x14a47870ee88c9d6 expref: 10 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727271.359910:0:5936:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782727271.359930:0:5936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c45e44a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c71e9f0f-6441-4b9b-bc96-153ab9250801+9:3442:x1869324939696384:12345-0@lo:103: Request processed in 81us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727271.359934:0:5936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782727271.359953:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c6e382680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c71e9f0f-6441-4b9b-bc96-153ab9250801:3442:1869324939696384:0@lo:103: 00000100:00100000:1.0:1782727271.360262:0:6942:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c66f89000 going to sleep for 11 seconds 00000100:00100000:0.0:1782727271.360309:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939696512 00000100:00100000:0.0:1782727271.360313:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939696512 00000100:00100000:0.0:1782727271.360330:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1782727271.360334:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6dd3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+9:6942:x1869324939696512:12345-0@lo:101: 00010000:00010000:0.0:1782727271.360340:0:5943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727271.360349:0:5943:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921c7a3e1e00/0x14a47870ee88c9eb lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x14a47870ee88c9e4 expref: -99 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727271.360362:0:5943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921c7a3e1e00/0x14a47870ee88c9eb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x14a47870ee88c9e4 expref: 10 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727271.360368:0:5943:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921c7a3e1e00/0x14a47870ee88c9eb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x14a47870ee88c9e4 expref: 10 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727271.360372:0:5943:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c7a3e1e00, rc 0) 00000100:00100000:0.0:1782727271.360400:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6dd3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+10:6942:x1869324939696512:12345-0@lo:101: Request processed in 65us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727271.360410:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1782727271.360443:0:6942:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c6e381180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:6942:1869324939696512:0@lo:101: 00010000:00010000:1.0:1782727271.360454:0:6942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff921c43a23600/0x14a47870ee88c9e4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88c9eb expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727271.360462:0:6942:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff921c43a23600/0x14a47870ee88c9e4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x14a47870ee88c9eb expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782727271.360477:0:6942:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782727271.360496:0:6942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff921c43a23600/0x14a47870ee88c9e4 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88c9eb expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727271.360504:0:6942:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff921c43a23600/0x14a47870ee88c9e4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88c9eb expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782727271.360511:0:6942:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1782727271.360515:0:6942:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1782727271.360519:0:6942:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1782727271.360522:0:6942:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1782727271.360535:0:6942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff921c43a23c00/0x14a47870ee88c9f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727271.360543:0:6942:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff921c43a23c00/0x14a47870ee88c9f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727271.360557:0:6942:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff921c43a23c00/0x14a47870ee88c9f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727271.360569:0:6942:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c6e381180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:6942:1869324939696640:0@lo:101: 00000100:00100000:1.0:1782727271.360590:0:6942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727271.360604:0:6942:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c66f89000 going to sleep for 11 seconds 00000100:00100000:0.0:1782727271.360618:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939696640 00000100:00100000:0.0:1782727271.360628:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939696640 00000100:00100000:0.0:1782727271.360684:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1782727271.360692:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6dd3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+10:6942:x1869324939696640:12345-0@lo:101: 00010000:00010000:0.0:1782727271.360699:0:5943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727271.360706:0:5943:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921c7a3e0e00/0x14a47870ee88c9f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x14a47870ee88c9f2 expref: -99 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727271.360716:0:5943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921c7a3e0e00/0x14a47870ee88c9f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x14a47870ee88c9f2 expref: 11 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727271.360721:0:5943:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921c7a3e0e00/0x14a47870ee88c9f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x14a47870ee88c9f2 expref: 11 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727271.360725:0:5943:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c7a3e0e00, rc 0) 00000100:00100000:0.0:1782727271.360749:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6dd3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+11:6942:x1869324939696640:12345-0@lo:101: Request processed in 59us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727271.360755:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1782727271.360772:0:6942:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c6e381180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:6942:1869324939696640:0@lo:101: 00010000:00010000:1.0:1782727271.360781:0:6942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff921c43a23c00/0x14a47870ee88c9f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88c9f9 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727271.360788:0:6942:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff921c43a23c00/0x14a47870ee88c9f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x14a47870ee88c9f9 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727271.360849:0:6942:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c6e381180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:6942:1869324939696768:0@lo:501: 00000100:00100000:1.0:1782727271.360874:0:6942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727271.360911:0:6942:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c66f89000 going to sleep for 11 seconds 00000100:00100000:3.0:1782727271.360983:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939696768 00000100:00100000:3.0:1782727271.360987:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939696768 00000100:00100000:3.0:1782727271.361016:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1782727271.361023:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6dd3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+11:6942:x1869324939696768:12345-0@lo:501: 00000100:00100000:3.0:1782727271.361216:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6dd3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+11:6942:x1869324939696768:12345-0@lo:501: Request processed in 192us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727271.361222:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1782727271.361285:0:6942:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c6e381180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:6942:1869324939696768:0@lo:501: 00000100:00100000:1.0:1782727271.361382:0:6942:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c6e381180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:6942:1869324939696896:0@lo:503: 00000100:00100000:1.0:1782727271.361432:0:6942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727271.361534:0:6942:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c66f89000 going to sleep for 11 seconds 00000100:00100000:3.0:1782727271.361555:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939696896 00000100:00100000:3.0:1782727271.361557:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939696896 00000100:00100000:3.0:1782727271.361598:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1782727271.361602:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6dd3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+11:6942:x1869324939696896:12345-0@lo:503: 00000100:00100000:3.0:1782727271.361680:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6dd3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+11:6942:x1869324939696896:12345-0@lo:503: Request processed in 77us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727271.361685:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1782727271.361730:0:6942:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c6e381180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:6942:1869324939696896:0@lo:503: 00000040:00080000:1.0:1782727271.361952:0:6942:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1782727271.362027:0:6942:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c6e381180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:6942:1869324939697024:0@lo:502: 00000100:00100000:1.0:1782727271.362059:0:6942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727271.362474:0:6942:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c66f89000 going to sleep for 11 seconds 00000100:00100000:2.0:1782727271.362572:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939697024 00000100:00100000:2.0:1782727271.362577:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939697024 00000100:00100000:2.0:1782727271.362603:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1782727271.362611:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6dd3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+11:6942:x1869324939697024:12345-0@lo:502: 00000100:00100000:2.0:1782727271.362742:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6dd3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+11:6942:x1869324939697024:12345-0@lo:502: Request processed in 131us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727271.362749:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1782727271.363074:0:6942:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c6e381180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:6942:1869324939697024:0@lo:502: 00000040:00080000:1.0:1782727271.363441:0:6942:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1782727271.363469:0:6942:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1782727271.363482:0:6942:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1782727271.363492:0:6942:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1782727271.363503:0:6942:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1782727271.363515:0:6942:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1782727271.363539:0:6942:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c6e381180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:6942:1869324939697152:0@lo:502: 00000100:00100000:1.0:1782727271.363578:0:6942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727271.363641:0:6942:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c66f89000 going to sleep for 11 seconds 00000100:00100000:2.0:1782727271.363676:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939697152 00000100:00100000:2.0:1782727271.363681:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939697152 00000100:00100000:2.0:1782727271.363713:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1782727271.363720:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6dd3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+11:6942:x1869324939697152:12345-0@lo:502: 00000100:00100000:2.0:1782727271.363827:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6dd3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+11:6942:x1869324939697152:12345-0@lo:502: Request processed in 107us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727271.363834:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1782727271.364189:0:6942:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c6e381180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:6942:1869324939697152:0@lo:502: 00000040:00080000:1.0:1782727271.364221:0:6942:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1782727271.364228:0:6942:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:1.0:1782727271.364672:0:6964:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1782727271.364678:0:6964:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1782727271.364683:0:6964:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782727271.364685:0:6964:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1782727271.364689:0:6964:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1782727271.364708:0:6964:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff921c7d4433a0) 00000020:00000080:1.0:1782727271.364722:0:6964:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:1.0:1782727271.364728:0:6964:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1782727271.364784:0:6964:0:(tgt_mount.c:153:server_get_mount()) get mount ffff921c45e6f800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1782727271.364789:0:6964:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:1.0:1782727271.364793:0:6964:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x14a47870ee88ca07 00010000:00010000:1.0:1782727271.369070:0:6964:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:1.0:1782727271.369321:0:6964:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1782727271.371742:0:6964:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1782727271.372141:0:6964:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1782727271.377805:0:6964:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:0.0:1782727271.378514:0:6964:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:0.0:1782727271.383678:0:6964:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:0.0:1782727271.385521:0:6964:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1782727271.385533:0:6964:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782727271.385539:0:6964:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782727271.385541:0:6964:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1782727271.385544:0:6964:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782727271.385548:0:6964:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782727271.385549:0:6964:0:(obd_config.c:1561:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:0.0:1782727271.385553:0:6964:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1782727271.385554:0:6964:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1782727271.385577:0:6964:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782727271.385580:0:6964:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782727271.385589:0:6964:0:(obd_config.c:1561:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:0.0:1782727271.385593:0:6964:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1782727271.385736:0:6942:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1782727271.385762:0:6942:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1782727271.385789:0:6942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff921c43a23c00/0x14a47870ee88c9f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88c9f9 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727271.385801:0:6942:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff921c43a23c00/0x14a47870ee88c9f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88c9f9 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782727271.385809:0:6942:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff921c45e6f800 from 1 10000000:01000000:1.0:1782727271.385812:0:6942:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782727271.385844:0:6942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff921c43a22a00/0x14a47870ee88ca0e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727271.385861:0:6942:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff921c43a22a00/0x14a47870ee88ca0e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727271.385872:0:6942:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff921c43a22a00/0x14a47870ee88ca0e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727271.385914:0:6942:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c6e381180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:6942:1869324939697280:0@lo:101: 00000100:00100000:1.0:1782727271.385979:0:6942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727271.386031:0:6942:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c66f89480 going to sleep for 11 seconds 00000100:00100000:3.0:1782727271.386102:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939697280 00000100:00100000:3.0:1782727271.386109:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939697280 00000100:00100000:3.0:1782727271.386155:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1782727271.386164:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6dd3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+11:6942:x1869324939697280:12345-0@lo:101: 00010000:00010000:3.0:1782727271.386177:0:5943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727271.386194:0:5943:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921c4151cc00/0x14a47870ee88ca15 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x14a47870ee88ca0e expref: -99 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727271.386217:0:5943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921c4151cc00/0x14a47870ee88ca15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x14a47870ee88ca0e expref: 12 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727271.386227:0:5943:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921c4151cc00/0x14a47870ee88ca15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x14a47870ee88ca0e expref: 12 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727271.386234:0:5943:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c4151cc00, rc 0) 00000100:00100000:3.0:1782727271.386270:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6dd3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+12:6942:x1869324939697280:12345-0@lo:101: Request processed in 108us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727271.386278:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1782727271.386774:0:6942:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c6e381180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:6942:1869324939697280:0@lo:101: 00010000:00010000:1.0:1782727271.386788:0:6942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff921c43a22a00/0x14a47870ee88ca0e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88ca15 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727271.386798:0:6942:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff921c43a22a00/0x14a47870ee88ca0e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x14a47870ee88ca15 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727271.386915:0:6942:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c6e381180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:6942:1869324939697408:0@lo:501: 00000100:00100000:1.0:1782727271.386943:0:6942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727271.386973:0:6942:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c66f89480 going to sleep for 11 seconds 00000100:00100000:1.0:1782727271.386991:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939697408 00000100:00100000:1.0:1782727271.386996:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939697408 00000100:00100000:1.0:1782727271.387031:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1782727271.387038:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6dd3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+12:6942:x1869324939697408:12345-0@lo:501: 00000100:00100000:1.0:1782727271.387125:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6dd3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+12:6942:x1869324939697408:12345-0@lo:501: Request processed in 87us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727271.387132:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1782727271.387164:0:6942:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c6e381180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:6942:1869324939697408:0@lo:501: 00000100:00100000:1.0:1782727271.387197:0:6942:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c6e381180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:6942:1869324939697536:0@lo:503: 00000100:00100000:1.0:1782727271.387231:0:6942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727271.387245:0:6942:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c66f89480 going to sleep for 11 seconds 00000100:00100000:1.0:1782727271.387256:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939697536 00000100:00100000:1.0:1782727271.387259:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939697536 00000100:00100000:1.0:1782727271.387275:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1782727271.387280:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6dd3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+12:6942:x1869324939697536:12345-0@lo:503: 00000100:00100000:1.0:1782727271.387348:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6dd3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+12:6942:x1869324939697536:12345-0@lo:503: Request processed in 67us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727271.387355:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1782727271.387394:0:6942:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c6e381180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:6942:1869324939697536:0@lo:503: 00000040:00080000:1.0:1782727271.387629:0:6942:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1782727271.387690:0:6942:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c6e381180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:6942:1869324939697664:0@lo:502: 00000100:00100000:1.0:1782727271.387726:0:6942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727271.387740:0:6942:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c66f89480 going to sleep for 11 seconds 00000100:00100000:1.0:1782727271.387755:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939697664 00000100:00100000:1.0:1782727271.387758:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939697664 00000100:00100000:1.0:1782727271.387776:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1782727271.387789:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6dd3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+12:6942:x1869324939697664:12345-0@lo:502: 00000100:00100000:1.0:1782727271.387858:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6dd3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+12:6942:x1869324939697664:12345-0@lo:502: Request processed in 70us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727271.387865:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1782727271.387921:0:6942:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c6e381180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:6942:1869324939697664:0@lo:502: 00000040:00080000:1.0:1782727271.388083:0:6942:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1782727271.388106:0:6942:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1782727271.388124:0:6942:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c6e381180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:6942:1869324939697792:0@lo:502: 00000100:00100000:1.0:1782727271.388156:0:6942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727271.388168:0:6942:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c66f89480 going to sleep for 11 seconds 00000100:00100000:1.0:1782727271.388180:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939697792 00000100:00100000:1.0:1782727271.388183:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939697792 00000100:00100000:1.0:1782727271.388200:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1782727271.388205:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6dd3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+12:6942:x1869324939697792:12345-0@lo:502: 00000100:00100000:1.0:1782727271.388262:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6dd3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+12:6942:x1869324939697792:12345-0@lo:502: Request processed in 56us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727271.388269:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1782727271.388302:0:6942:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c6e381180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:6942:1869324939697792:0@lo:502: 00000040:00080000:1.0:1782727271.388335:0:6942:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1782727271.388342:0:6942:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1782727271.389210:0:6967:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782727271.389219:0:6967:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782727271.389222:0:6967:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1782727271.389228:0:6967:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff921c45e6f800 00000020:00000080:1.0:1782727271.389230:0:6967:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1782727271.389239:0:6967:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782727271.389241:0:6967:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782727271.389249:0:6967:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1782727271.389252:0:6967:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1782727271.389370:0:6942:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1782727271.389393:0:6942:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782727271.389413:0:6942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff921c43a22a00/0x14a47870ee88ca0e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88ca15 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727271.389434:0:6942:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff921c43a22a00/0x14a47870ee88ca0e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88ca15 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727271.389479:0:6942:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1782727271.389482:0:6942:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff921c45e6f800 10000000:01000000:3.0:1782727271.389485:0:6942:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff921c45e6f800 10000000:01000000:3.0:1782727271.389489:0:6942:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1782727271.389494:0:6942:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff921c45e6f800 from 1 10000000:01000000:3.0:1782727271.389497:0:6942:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1782727271.389522:0:6942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff921c4151d200/0x14a47870ee88ca1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727271.389531:0:6942:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff921c4151d200/0x14a47870ee88ca1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727271.389548:0:6942:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff921c4151d200/0x14a47870ee88ca1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727271.389565:0:6942:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e45180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:6942:1869324939697920:0@lo:101: 00000100:00100000:3.0:1782727271.389606:0:6942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727271.389641:0:6942:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c7a327840 going to sleep for 11 seconds 00000100:00100000:1.0:1782727271.390235:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939697920 00000100:00100000:1.0:1782727271.390242:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939697920 00000100:00100000:1.0:1782727271.390275:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1782727271.390283:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6dd3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+12:6942:x1869324939697920:12345-0@lo:101: 00010000:00010000:1.0:1782727271.390293:0:5942:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727271.390305:0:5942:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921c43a22800/0x14a47870ee88ca23 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x14a47870ee88ca1c expref: -99 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727271.390326:0:5942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921c43a22800/0x14a47870ee88ca23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x14a47870ee88ca1c expref: 13 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727271.390336:0:5942:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921c43a22800/0x14a47870ee88ca23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x14a47870ee88ca1c expref: 13 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727271.390344:0:5942:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c43a22800, rc 0) 00000100:00100000:1.0:1782727271.390398:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6dd3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+13:6942:x1869324939697920:12345-0@lo:101: Request processed in 115us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727271.390404:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1782727271.390515:0:6942:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e45180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:6942:1869324939697920:0@lo:101: 00010000:00010000:0.0:1782727271.390528:0:6942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff921c4151d200/0x14a47870ee88ca1c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88ca23 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727271.390537:0:6942:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff921c4151d200/0x14a47870ee88ca1c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x14a47870ee88ca23 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727271.390625:0:6942:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c76441c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:6942:1869324939698048:0@lo:501: 00000100:00100000:0.0:1782727271.390651:0:6942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727271.390687:0:6942:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c4685fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1782727271.390731:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939698048 00000100:00100000:1.0:1782727271.390736:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939698048 00000100:00100000:1.0:1782727271.390764:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1782727271.390771:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6dd3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+13:6942:x1869324939698048:12345-0@lo:501: 00000100:00100000:1.0:1782727271.390872:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6dd3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+13:6942:x1869324939698048:12345-0@lo:501: Request processed in 101us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727271.390878:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1782727271.390982:0:6942:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c76441c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:6942:1869324939698048:0@lo:501: 00000100:00100000:0.0:1782727271.391006:0:6942:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c76441c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:6942:1869324939698176:0@lo:503: 00000100:00100000:0.0:1782727271.391050:0:6942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727271.391074:0:6942:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c4685fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1782727271.391294:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939698176 00000100:00100000:1.0:1782727271.391298:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939698176 00000100:00100000:1.0:1782727271.391333:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1782727271.391339:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6dd3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+13:6942:x1869324939698176:12345-0@lo:503: 00000100:00100000:1.0:1782727271.391412:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6dd3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+13:6942:x1869324939698176:12345-0@lo:503: Request processed in 71us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727271.391430:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1782727271.391506:0:6942:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c76441c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:6942:1869324939698176:0@lo:503: 00000040:00080000:0.0:1782727271.391725:0:6942:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1782727271.391784:0:6942:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c76441c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:6942:1869324939698304:0@lo:502: 00000100:00100000:0.0:1782727271.391815:0:6942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727271.391833:0:6942:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c4478cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1782727271.391949:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939698304 00000100:00100000:1.0:1782727271.391953:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939698304 00000100:00100000:1.0:1782727271.391979:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1782727271.391986:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6dd3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+13:6942:x1869324939698304:12345-0@lo:502: 00000100:00100000:1.0:1782727271.392056:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6dd3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+13:6942:x1869324939698304:12345-0@lo:502: Request processed in 70us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727271.392063:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1782727271.392222:0:6942:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c76441c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:6942:1869324939698304:0@lo:502: 00000040:00080000:0.0:1782727271.392394:0:6942:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1782727271.392432:0:6942:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1782727271.392449:0:6942:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1782727271.392461:0:6942:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1782727271.392474:0:6942:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1782727271.392497:0:6942:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1782727271.392509:0:6942:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1782727271.392521:0:6942:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1782727271.392533:0:6942:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1782727271.392545:0:6942:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1782727271.392557:0:6942:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1782727271.392569:0:6942:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1782727271.392582:0:6942:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1782727271.392607:0:6942:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1782727271.392625:0:6942:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1782727271.392638:0:6942:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1782727271.392650:0:6942:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1782727271.392660:0:6942:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1782727271.392671:0:6942:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1782727271.392683:0:6942:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1782727271.392695:0:6942:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1782727271.392707:0:6942:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1782727271.392720:0:6942:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1782727271.392735:0:6942:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1782727271.392747:0:6942:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1782727271.392759:0:6942:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1782727271.392770:0:6942:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1782727271.392780:0:6942:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:0.0:1782727271.392803:0:6942:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c76441c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:6942:1869324939698432:0@lo:502: 00000100:00100000:0.0:1782727271.392839:0:6942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727271.402382:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939698432 00000100:00100000:1.0:1782727271.402398:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939698432 00000100:00100000:1.0:1782727271.402482:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1782727271.402494:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6dd3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+13:6942:x1869324939698432:12345-0@lo:502: 00000100:00100000:1.0:1782727271.402654:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6dd3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+13:6942:x1869324939698432:12345-0@lo:502: Request processed in 162us (9813us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727271.402662:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1782727271.411065:0:6942:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c4478cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1782727271.411117:0:6942:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c76441c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:6942:1869324939698432:0@lo:502: 00000040:00080000:0.0:1782727271.411218:0:6942:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1782727271.411233:0:6942:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1782727271.412552:0:6969:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1782727271.412567:0:6969:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff921c7d4419d0) 00000020:00000080:1.0:1782727271.412587:0:6969:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:1.0:1782727271.412747:0:6969:0:(tgt_mount.c:153:server_get_mount()) get mount ffff921c45e6f800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1782727271.412751:0:6969:0:(tgt_mount.c:187:server_put_mount()) put mount ffff921c45e6f800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1782727271.412754:0:6969:0:(obd_mount.c:701:lustre_put_lsi()) put ffff921c45e6f800 3 00010000:00080000:1.0:1782727271.412782:0:6969:0:(ldlm_lib.c:102:import_set_conn()) imp ffff921c7d427000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.160@tcp at head 00010000:00010000:1.0:1782727271.415060:0:6969:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:1.0:1782727271.415168:0:6969:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1782727271.415216:0:6969:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1782727271.415229:0:6969:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x14a47870ee88ca31 00000100:00080000:1.0:1782727271.415241:0:6969:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782727271.415248:0:6969:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff921c7d427000 using connection 192.168.202.160@tcp/0@lo 00000100:00100000:1.0:1782727271.415287:0:6969:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff921c6e381180 x1869324939698560/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1782727271.415315:0:6969:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1782727271.415878:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3443:1869324939698688:0@lo:400: 00000100:00100000:3.0:1782727271.415975:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727271.416210:0:3441:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c6e381180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3441:1869324939698560:0@lo:38: 00000100:00100000:0.0:1782727271.416245:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727271.416328:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939698688 00000100:00100000:3.0:1782727271.416335:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939698688 00000100:00100000:3.0:1782727271.416378:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939698560 00000100:00100000:3.0:1782727271.416381:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939698560 00000100:00100000:3.0:1782727271.416395:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782727271.416403:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c45e47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1869324939698688:12345-0@lo:400: 00000100:00100000:3.0:1782727271.416464:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c45e47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1869324939698688:12345-0@lo:400: Request processed in 61us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727271.416471:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782727271.416484:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782727271.416488:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c76441c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3441:x1869324939698560:12345-0@lo:38: 00010000:00080000:3.0:1782727271.416506:0:5950:0:(ldlm_lib.c:1434:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 166 last 0 00000020:00000080:3.0:1782727271.416532:0:5950:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x14a47870ee88ca38 00000004:00100000:3.0:1782727271.416544:0:5950:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1782727271.416569:0:5950:0:(import.c:65:import_set_state_nolock()) ffff921c476f5800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782727271.416602:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c76441c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3441:x1869324939698560:12345-0@lo:38: Request processed in 112us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727271.416609:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1782727271.416651:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff921c45e44380 x1869324939698688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727271.416665:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3443:1869324939698688:0@lo:400: 00010000:00080000:0.0:1782727271.416737:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff921c6e381180 x1869324939698560/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782727281 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727271.416745:0:3441:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1782727271.416751:0:3441:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1782727271.416757:0:3441:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1782727271.416762:0:3441:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1782727271.416765:0:3441:0:(import.c:65:import_set_state_nolock()) ffff921c7d427000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1782727271.416770:0:3441:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c6e381180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3441:1869324939698560:0@lo:38: 00000040:00080000:0.0:1782727271.418704:0:6969:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:0.0:1782727271.418755:0:6942:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1782727271.418785:0:6942:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1782727271.418803:0:6942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff921c4151d200/0x14a47870ee88ca1c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88ca23 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727271.418814:0:6942:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff921c4151d200/0x14a47870ee88ca1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88ca23 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1782727271.418876:0:6942:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1782727271.418879:0:6942:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1782727271.418880:0:6942:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782727271.418903:0:6942:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782727271.418904:0:6942:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782727271.418906:0:6942:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782727271.418908:0:6942:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782727271.418909:0:6942:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1782727271.418911:0:6942:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1782727271.418912:0:6942:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782727271.418914:0:6942:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1782727271.418917:0:6942:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1782727271.418920:0:6942:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1782727271.418921:0:6942:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1782727271.418922:0:6942:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782727271.418930:0:6942:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782727271.418931:0:6942:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782727271.418932:0:6942:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782727271.418933:0:6942:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782727271.418934:0:6942:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1782727271.418934:0:6942:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1782727271.418935:0:6942:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782727271.418936:0:6942:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1782727271.418958:0:6942:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1782727271.418975:0:6942:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c76440700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:6942:1869324939698816:0@lo:253: 00000100:00100000:0.0:1782727271.419030:0:6942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727271.419063:0:6942:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c4478c180 going to sleep for 11 seconds 00000100:00100000:0.0:1782727271.419102:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939698816 00000100:00100000:0.0:1782727271.419108:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939698816 00000100:00100000:0.0:1782727271.419157:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1782727271.419167:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5d073c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+13:6942:x1869324939698816:12345-0@lo:253: 20000000:01000000:0.0:1782727271.419190:0:5942:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1782727271.419204:0:5942:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1782727271.430163:0:5942:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1782727271.430182:0:5942:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1782727271.430315:0:5965:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1782727271.430320:0:5965:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1782727271.430342:0:5965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff921c429d5c00/0x14a47870ee88ca3f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727271.430360:0:5965:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff921c7a3e0000/0x14a47870ee88c99e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x14a47870ee88c997 expref: 13 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727271.430387:0:5965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff921c429d5c00/0x14a47870ee88ca3f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727271.430435:0:5965:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff921c7a3e0000/0x14a47870ee88c99e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x14a47870ee88c997 expref: 13 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727271.430449:0:5965:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff921c7a3e0000/0x14a47870ee88c99e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x14a47870ee88c997 expref: 13 pid: 5942 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727271.430463:0:5965:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e42300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5965:1869324939698944:0@lo:104: 00000100:00100000:2.0:1782727271.430525:0:5965:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727271.430572:0:5965:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c5152f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782727271.430696:0:5933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939698944 00000100:00100000:1.0:1782727271.430704:0:5933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939698944 00000100:00100000:1.0:1782727271.430757:0:5933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782727271.430767:0:5933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c45e40a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c71e9f0f-6441-4b9b-bc96-153ab9250801+3:5965:x1869324939698944:12345-0@lo:104: 00010000:00010000:1.0:1782727271.430780:0:5933:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.160@tcp lock: ffff921c8215f000/0x14a47870ee88c997 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x14a47870ee88c99e expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727271.430829:0:5933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782727271.430835:0:5933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c45e40a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c71e9f0f-6441-4b9b-bc96-153ab9250801+3:5965:x1869324939698944:12345-0@lo:104: Request processed in 71us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727271.430841:0:5933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1782727271.430863:0:5938:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782727271.430868:0:5938:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff921c8215f000/0x14a47870ee88c997 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x14a47870ee88c99e expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727271.430875:0:5938:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c8215f000 already unused, calling callback (ffffffffc12b0c20) 10000000:00010000:1.0:1782727271.430879:0:5938:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff921c8215f000/0x14a47870ee88c997 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x14a47870ee88c99e expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727271.430912:0:5938:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff921c8215f000/0x14a47870ee88c997 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x14a47870ee88c99e expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782727271.430926:0:5938:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff921c8215f000/0x14a47870ee88c997 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x14a47870ee88c99e expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782727271.430930:0:5938:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1782727271.430956:0:5938:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff921c8215f000/0x14a47870ee88c997 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x14a47870ee88c99e expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727271.430962:0:5938:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1782727271.431030:0:5965:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e42300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5965:1869324939698944:0@lo:104: 00010000:00010000:2.0:1782727271.431049:0:5965:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff921c429d5c00/0x14a47870ee88ca3f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727271.437142:0:5938:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff921c8215f000/0x14a47870ee88c997 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x14a47870ee88c99e expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727271.437161:0:5938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff921c8215f000/0x14a47870ee88c997 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x14a47870ee88c99e expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727271.437307:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c6e383b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c71e9f0f-6441-4b9b-bc96-153ab9250801:3444:1869324939699072:0@lo:103: 00000100:00100000:3.0:1782727271.437387:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727271.437567:0:5935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939699072 00000100:00100000:0.0:1782727271.437575:0:5935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939699072 00010000:00010000:0.0:1782727271.437609:0:5935:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff921c7a3e0000/0x14a47870ee88c99e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x14a47870ee88c997 expref: 14 pid: 5942 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727271.437645:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782727271.437655:0:5935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5302d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c71e9f0f-6441-4b9b-bc96-153ab9250801+14:3444:x1869324939699072:12345-0@lo:103: 00010000:00010000:0.0:1782727271.437668:0:5935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782727271.437674:0:5935:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff921c7a3e0000/0x14a47870ee88c99e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x14a47870ee88c997 expref: 14 pid: 5942 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727271.437685:0:5935:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff921c7a3e0000/0x14a47870ee88c99e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x14a47870ee88c997 expref: 14 pid: 5942 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727271.437702:0:5935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921c7a3e0000/0x14a47870ee88c99e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x14a47870ee88c997 expref: 14 pid: 5942 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727271.437728:0:5935:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff921c429d5c00/0x14a47870ee88ca3f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727271.437736:0:5935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921c429d5c00/0x14a47870ee88ca3f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1782727271.437751:0:5935:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007431111s 00010000:00010000:0.0:1782727271.437755:0:5935:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff921c429d5c00/0x14a47870ee88ca3f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727271.437761:0:5935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff921c429d5c00/0x14a47870ee88ca3f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727271.437768:0:5935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff921c429d5c00/0x14a47870ee88ca3f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727271.437774:0:5935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff921c429d5c00/0x14a47870ee88ca3f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727271.437780:0:5935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c429d5c00 already unused, calling callback (ffffffffc0c98cf0) 00010000:00010000:0.0:1782727271.437783:0:5935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff921c429d5c00/0x14a47870ee88ca3f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727271.437791:0:5935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff921c429d5c00/0x14a47870ee88ca3f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727271.437807:0:5935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff921c429d5c00/0x14a47870ee88ca3f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727271.437817:0:5935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782727271.437873:0:5935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5302d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c71e9f0f-6441-4b9b-bc96-153ab9250801+13:3444:x1869324939699072:12345-0@lo:103: Request processed in 219us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727271.437910:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1782727271.438031:0:5965:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff921c429d5c00/0x14a47870ee88ca3f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727271.438039:0:5965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff921c429d5c00/0x14a47870ee88ca3f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727271.438045:0:5965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921c429d5c00/0x14a47870ee88ca3f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727271.438086:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c6e383b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c71e9f0f-6441-4b9b-bc96-153ab9250801:3444:1869324939699072:0@lo:103: 00010000:00010000:0.0:1782727271.438119:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727271.438122:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727271.438124:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727271.439032:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5d073c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+12:6942:x1869324939698816:12345-0@lo:253: Request processed in 19864us (19999us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727271.439042:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1782727271.439100:0:6942:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c76440700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:6942:1869324939698816:0@lo:253: 10000000:01000000:0.0:1782727271.439114:0:6942:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1782727271.439116:0:6942:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1782727271.439118:0:6942:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1782727271.439119:0:6942:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782727271.439120:0:6942:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782727271.439122:0:6942:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782727271.439123:0:6942:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782727271.439125:0:6942:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782727271.439126:0:6942:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1782727271.439128:0:6942:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1782727271.439129:0:6942:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782727271.439131:0:6942:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1782727271.439153:0:6942:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1782727271.448744:0:6942:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1782727271.448953:0:6942:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1782727271.449400:0:6942:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1782727271.449576:0:6942:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1782727271.449778:0:6942:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1782727271.450018:0:6942:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:0.0:1782727271.452755:0:6942:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1782727271.467031:0:6942:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1782727271.467040:0:6942:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1782727271.467078:0:6942:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1782727271.467194:0:6942:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.160@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1782727271.467219:0:6942:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1782727271.467242:0:6942:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1782727271.470579:0:6942:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1782727271.470773:0:6942:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1782727271.866139:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1782727272.398446:0:7023:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1782727272.398649:0:7023:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1782727272.890065:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727273.913017:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727274.937135:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727275.961711:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727276.735070:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c76440700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c71e9f0f-6441-4b9b-bc96-153ab9250801:3445:1869324939699200:0@lo:400: 00000100:00100000:0.0:1782727276.735146:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727276.735222:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c76440e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3442:1869324939699328:0@lo:400: 00000100:00100000:0.0:1782727276.735289:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727276.735310:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782727276.735317:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c76443100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3442:1869324939699456:0@lo:400: 00000100:00100000:0.0:1782727276.735339:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727276.735384:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939699200 00000100:00100000:0.0:1782727276.735391:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939699200 00000100:00100000:0.0:1782727276.735451:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1782727276.735461:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5d072850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+12:3445:x1869324939699200:12345-0@lo:400: 00000100:00100000:0.0:1782727276.735513:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5d072850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+12:3445:x1869324939699200:12345-0@lo:400: Request processed in 53us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727276.735528:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1782727276.735566:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939699328 00000100:00100000:0.0:1782727276.735570:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939699328 00000100:00100000:0.0:1782727276.735594:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939699456 00000100:00100000:0.0:1782727276.735597:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939699456 00000100:00100000:0.0:1782727276.735620:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782727276.735626:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c76443480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1869324939699328:12345-0@lo:400: 00000100:00100000:0.0:1782727276.735664:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c76443480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1869324939699328:12345-0@lo:400: Request processed in 38us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727276.735670:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782727276.735682:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782727276.735688:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c76440000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1869324939699456:12345-0@lo:400: 00000100:00100000:0.0:1782727276.735716:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c76440000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1869324939699456:12345-0@lo:400: Request processed in 28us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727276.735722:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1782727276.735765:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff921c76443100 x1869324939699456/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727292 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727276.735778:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c76443100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3442:1869324939699456:0@lo:400: 00010000:00080000:0.0:1782727276.735803:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff921c76440e00 x1869324939699328/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727292 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727276.735813:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c76440e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3442:1869324939699328:0@lo:400: 00000100:00080000:2.0:1782727276.736670:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782727276.737668:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c76440700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c71e9f0f-6441-4b9b-bc96-153ab9250801:3445:1869324939699200:0@lo:400: 00010000:00010000:0.0:1782727276.985261:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782727277.883773:0:7313:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg260-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1782727278.011243:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1782727278.997847:0:7365:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1782727278.998302:0:7365:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1782727279.040916:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727280.057251:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782727280.313027:0:5946:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1782727280.313037:0:5946:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff921c479c5800 from 21 10000000:01000000:0.0:1782727280.313063:0:5946:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1782727280.313109:0:5946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff921c7a3e0a00/0x14a47870ee88ca46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727280.313121:0:5946:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff921c7a3e0a00/0x14a47870ee88ca46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727280.313132:0:5946:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff921c7a3e0a00/0x14a47870ee88ca46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727280.313157:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c76440700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939699584:0@lo:101: 00000100:00100000:0.0:1782727280.313230:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727280.313305:0:5946:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c465b40c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782727280.313767:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939699584 00000100:00100000:1.0:1782727280.313775:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939699584 00000100:00100000:1.0:1782727280.313907:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1782727280.313917:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5d070450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+12:5946:x1869324939699584:12345-0@lo:101: 00010000:00010000:1.0:1782727280.313932:0:5942:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727280.313944:0:5942:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921c43a22c00/0x14a47870ee88ca4d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x14a47870ee88ca46 expref: -99 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727280.313970:0:5942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921c43a22c00/0x14a47870ee88ca4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x14a47870ee88ca46 expref: 13 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727280.313980:0:5942:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921c43a22c00/0x14a47870ee88ca4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x14a47870ee88ca46 expref: 13 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727280.314001:0:5942:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c43a22c00, rc 0) 00000100:00100000:1.0:1782727280.314060:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5d070450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+13:5946:x1869324939699584:12345-0@lo:101: Request processed in 145us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727280.314067:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1782727280.314158:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c76440700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939699584:0@lo:101: 00010000:00010000:2.0:1782727280.314173:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff921c7a3e0a00/0x14a47870ee88ca46 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88ca4d expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727280.314183:0:5946:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff921c7a3e0a00/0x14a47870ee88ca46 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x14a47870ee88ca4d expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727280.314252:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e42300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939699712:0@lo:501: 00000100:00100000:2.0:1782727280.314280:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727280.314312:0:5946:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c56cd66c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782727280.314383:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939699712 00000100:00100000:0.0:1782727280.314387:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939699712 00000100:00100000:0.0:1782727280.314420:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1782727280.314426:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5d070850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+13:5946:x1869324939699712:12345-0@lo:501: 00000100:00100000:0.0:1782727280.314537:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5d070850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+13:5946:x1869324939699712:12345-0@lo:501: Request processed in 111us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727280.314544:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1782727280.314623:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e42300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939699712:0@lo:501: 00000100:00100000:2.0:1782727280.314653:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e42300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939699840:0@lo:503: 00000100:00100000:2.0:1782727280.314690:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727280.314709:0:5946:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c56cd66c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782727280.314767:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939699840 00000100:00100000:1.0:1782727280.314771:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939699840 00000100:00100000:1.0:1782727280.314799:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1782727280.314806:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6e0fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+13:5946:x1869324939699840:12345-0@lo:503: 00000100:00100000:1.0:1782727280.314880:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6e0fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+13:5946:x1869324939699840:12345-0@lo:503: Request processed in 74us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727280.314910:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1782727280.314950:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e42300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939699840:0@lo:503: 00000100:00100000:1.0:1782727280.317794:0:7417:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c6e382300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c71e9f0f-6441-4b9b-bc96-153ab9250801:7417:1869324939699968:0@lo:502: 00000100:00100000:1.0:1782727280.317873:0:7417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727280.317936:0:7417:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c46407900 going to sleep for 11 seconds 00000100:00100000:0.0:1782727280.318076:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939699968 00000100:00100000:0.0:1782727280.318085:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939699968 00000100:00100000:0.0:1782727280.329033:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1782727280.329056:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6e0fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+13:7417:x1869324939699968:12345-0@lo:502: 00000100:00100000:0.0:1782727280.329247:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6e0fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+13:7417:x1869324939699968:12345-0@lo:502: Request processed in 203us (11374us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727280.329265:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1782727280.329532:0:7417:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c6e382300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c71e9f0f-6441-4b9b-bc96-153ab9250801:7417:1869324939699968:0@lo:502: 00000100:00100000:1.0:1782727280.329601:0:7417:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c6e382300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c71e9f0f-6441-4b9b-bc96-153ab9250801:7417:1869324939700096:0@lo:502: 00000100:00100000:1.0:1782727280.329648:0:7417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727280.329690:0:7417:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c46407900 going to sleep for 11 seconds 00000100:00100000:0.0:1782727280.329734:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939700096 00000100:00100000:0.0:1782727280.329742:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939700096 00000100:00100000:0.0:1782727280.329788:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1782727280.329795:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6e0fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+13:7417:x1869324939700096:12345-0@lo:502: 00000100:00100000:0.0:1782727280.330277:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6e0fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+13:7417:x1869324939700096:12345-0@lo:502: Request processed in 481us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727280.330285:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1782727280.334545:0:7417:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c6e382300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c71e9f0f-6441-4b9b-bc96-153ab9250801:7417:1869324939700096:0@lo:502: 00000040:00080000:1.0:1782727280.334601:0:7417:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1782727280.334798:0:5946:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1782727280.334825:0:5946:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782727280.334838:0:5946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff921c7a3e0a00/0x14a47870ee88ca46 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88ca4d expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727280.334849:0:5946:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff921c7a3e0a00/0x14a47870ee88ca46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88ca4d expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782727280.334872:0:5946:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1782727280.334875:0:5946:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff921c479c5800 from 4 10000000:01000000:2.0:1782727280.334877:0:5946:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1782727280.334965:0:5946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff921c429d4400/0x14a47870ee88ca54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727280.334973:0:5946:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff921c429d4400/0x14a47870ee88ca54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727280.334982:0:5946:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff921c429d4400/0x14a47870ee88ca54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727280.335002:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e40e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939700224:0@lo:101: 00000100:00100000:2.0:1782727280.335076:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727280.335119:0:5946:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c4513fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1782727280.335658:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939700224 00000100:00100000:1.0:1782727280.335667:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939700224 00000100:00100000:1.0:1782727280.335711:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1782727280.335728:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6e0ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+13:5946:x1869324939700224:12345-0@lo:101: 00010000:00010000:1.0:1782727280.335740:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727280.335753:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921c43a22e00/0x14a47870ee88ca5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x14a47870ee88ca54 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727280.335775:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921c43a22e00/0x14a47870ee88ca5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x14a47870ee88ca54 expref: 14 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727280.335785:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921c43a22e00/0x14a47870ee88ca5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x14a47870ee88ca54 expref: 14 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727280.335794:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c43a22e00, rc 0) 00000100:00100000:1.0:1782727280.335836:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6e0ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+14:5946:x1869324939700224:12345-0@lo:101: Request processed in 111us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727280.335842:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1782727280.336484:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e40e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939700224:0@lo:101: 00010000:00010000:2.0:1782727280.336501:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff921c429d4400/0x14a47870ee88ca54 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88ca5b expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727280.336510:0:5946:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff921c429d4400/0x14a47870ee88ca54 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x14a47870ee88ca5b expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727280.336567:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e40e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939700352:0@lo:256: 00000100:00100000:2.0:1782727280.336603:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727280.336636:0:5946:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c4513fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1782727280.336690:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939700352 00000100:00100000:0.0:1782727280.336695:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939700352 00000100:00100000:0.0:1782727280.336730:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1782727280.336737:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6e0ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+14:5946:x1869324939700352:12345-0@lo:256: 20000000:01000000:0.0:1782727280.336750:0:5943:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1782727280.336765:0:5943:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1782727280.336767:0:5943:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1782727280.336845:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6e0ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+14:5946:x1869324939700352:12345-0@lo:256: Request processed in 109us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727280.336852:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1782727280.337300:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e40e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939700352:0@lo:256: 10000000:01000000:2.0:1782727280.337356:0:5946:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1782727280.337362:0:5946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff921c429d4400/0x14a47870ee88ca54 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88ca5b expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727280.337370:0:5946:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff921c429d4400/0x14a47870ee88ca54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88ca5b expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782727280.337378:0:5946:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1782727280.337380:0:5946:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1782727280.337382:0:5946:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1782727280.337403:0:5946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff921c429d5c00/0x14a47870ee88ca62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727280.337411:0:5946:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff921c429d5c00/0x14a47870ee88ca62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727280.337429:0:5946:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff921c429d5c00/0x14a47870ee88ca62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727280.337444:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e40e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939700480:0@lo:101: 00000100:00100000:2.0:1782727280.337472:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727280.337506:0:5946:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c58a36900 going to sleep for 11 seconds 00000100:00100000:3.0:1782727280.337619:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939700480 00000100:00100000:3.0:1782727280.337624:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939700480 00000100:00100000:3.0:1782727280.337662:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1782727280.337669:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6e0fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+14:5946:x1869324939700480:12345-0@lo:101: 00010000:00010000:3.0:1782727280.337678:0:5942:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727280.337690:0:5942:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921c4151c000/0x14a47870ee88ca69 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x14a47870ee88ca62 expref: -99 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727280.337711:0:5942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921c4151c000/0x14a47870ee88ca69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x14a47870ee88ca62 expref: 15 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727280.337721:0:5942:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921c4151c000/0x14a47870ee88ca69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x14a47870ee88ca62 expref: 15 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727280.337730:0:5942:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c4151c000, rc 0) 00000100:00100000:3.0:1782727280.337765:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6e0fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+15:5946:x1869324939700480:12345-0@lo:101: Request processed in 96us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727280.337771:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1782727280.338207:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e40e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939700480:0@lo:101: 00010000:00010000:2.0:1782727280.338219:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff921c429d5c00/0x14a47870ee88ca62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88ca69 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727280.338228:0:5946:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff921c429d5c00/0x14a47870ee88ca62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x14a47870ee88ca69 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727280.338390:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e40e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939700608:0@lo:501: 00000100:00100000:2.0:1782727280.338417:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727280.338529:0:5946:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c58a36900 going to sleep for 11 seconds 00000100:00100000:3.0:1782727280.345214:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939700608 00000100:00100000:3.0:1782727280.345230:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939700608 00000100:00100000:3.0:1782727280.345318:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1782727280.345328:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6e0ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+15:5946:x1869324939700608:12345-0@lo:501: 00000100:00100000:3.0:1782727280.345514:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6e0ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+15:5946:x1869324939700608:12345-0@lo:501: Request processed in 187us (7094us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727280.345522:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1782727280.345605:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e40e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939700608:0@lo:501: 00000100:00100000:3.0:1782727280.345656:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e44380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939700736:0@lo:503: 00000100:00100000:3.0:1782727280.345699:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727280.345727:0:5946:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c765a7300 going to sleep for 11 seconds 00000100:00100000:3.0:1782727280.345739:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939700736 00000100:00100000:3.0:1782727280.345742:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939700736 00000100:00100000:3.0:1782727280.345763:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1782727280.345769:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6e0fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+15:5946:x1869324939700736:12345-0@lo:503: 00000100:00100000:3.0:1782727280.345840:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6e0fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+15:5946:x1869324939700736:12345-0@lo:503: Request processed in 70us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727280.345847:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1782727280.350479:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e44380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939700736:0@lo:503: 00000100:00100000:1.0:1782727280.353857:0:7419:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c6e382300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c71e9f0f-6441-4b9b-bc96-153ab9250801:7419:1869324939700864:0@lo:502: 00000100:00100000:1.0:1782727280.353974:0:7419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727280.354031:0:7419:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c46407c00 going to sleep for 11 seconds 00000100:00100000:3.0:1782727280.354218:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939700864 00000100:00100000:3.0:1782727280.354226:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939700864 00000100:00100000:3.0:1782727280.354279:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1782727280.354287:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6e0fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+15:7419:x1869324939700864:12345-0@lo:502: 00000100:00100000:3.0:1782727280.354418:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6e0fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+15:7419:x1869324939700864:12345-0@lo:502: Request processed in 130us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727280.354426:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1782727280.357997:0:7419:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c6e382300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c71e9f0f-6441-4b9b-bc96-153ab9250801:7419:1869324939700864:0@lo:502: 00000020:01000000:1.0:1782727280.358046:0:7419:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1782727280.358054:0:7419:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1782727280.358064:0:7419:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782727280.358065:0:7419:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1782727280.358071:0:7419:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1782727280.358075:0:7419:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.160@tcp to nid 0x20000c0a8caa0 (192.168.202.160@tcp) 00000020:01000000:1.0:1782727280.358100:0:7419:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1782727280.358102:0:7419:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1782727280.358119:0:7419:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff921c7d440000) 00000020:00000080:1.0:1782727280.358149:0:7419:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1782727280.358155:0:7419:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1782727280.358925:0:7419:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1782727280.358933:0:7419:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:1.0:1782727280.359184:0:7419:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x14a47870ee88ca77 00010000:00080000:1.0:1782727280.359219:0:7419:0:(ldlm_lib.c:102:import_set_conn()) imp ffff921c6ddda800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.160@tcp at head 00010000:00010000:1.0:1782727280.360362:0:7419:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1782727280.367856:0:7419:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1782727280.367879:0:7419:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1782727280.368203:0:7419:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782727280.368500:0:7419:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782727280.368586:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1782727280.368671:0:7419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1782727280.373936:0:7420:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782727280.373944:0:7420:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1782727280.376077:0:7419:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1782727280.376090:0:7419:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1782727280.376122:0:7419:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1782727280.376140:0:7419:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x14a47870ee88ca7e 00000100:00080000:2.0:1782727280.376148:0:7419:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1782727280.376153:0:7419:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff921c6ddda800 using connection 192.168.202.160@tcp/0@lo 00000100:00100000:2.0:1782727280.376182:0:7419:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff921c45e43800 x1869324939700992/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1782727280.376204:0:7419:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1782727280.376255:0:7419:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782727280.376262:0:7419:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782727280.376264:0:7419:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1782727280.376266:0:7419:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782727280.376270:0:7419:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782727280.376271:0:7419:0:(obd_config.c:1561:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:2.0:1782727280.376274:0:7419:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1782727280.376275:0:7419:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1782727280.376297:0:7419:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e42a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c71e9f0f-6441-4b9b-bc96-153ab9250801:7419:1869324939701248:0@lo:502: 00000100:00100000:3.0:1782727280.376316:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869324939701120:0@lo:400: 00000100:00100000:2.0:1782727280.376383:0:7419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727280.376421:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727280.376429:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939701248 00000100:00100000:2.0:1782727280.376436:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939701248 00000100:00100000:3.0:1782727280.376480:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782727280.376491:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1782727280.376502:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6e0ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+15:7419:x1869324939701248:12345-0@lo:502: 00000100:00100000:3.0:1782727280.376505:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3444:1869324939701376:0@lo:400: 00000100:00100000:3.0:1782727280.376534:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727280.376568:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939701120 00000100:00100000:3.0:1782727280.376573:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939701120 00000100:00100000:3.0:1782727280.376600:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939701376 00000100:00100000:3.0:1782727280.376605:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939701376 00000100:00100000:2.0:1782727280.376621:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6e0ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+15:7419:x1869324939701248:12345-0@lo:502: Request processed in 119us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727280.376630:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1782727280.376634:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782727280.376643:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c45e45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869324939701120:12345-0@lo:400: 00000100:00100000:2.0:1782727280.376680:0:7419:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c58a36600 going to sleep for 11 seconds 00000100:00100000:3.0:1782727280.376689:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c45e45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869324939701120:12345-0@lo:400: Request processed in 46us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727280.376697:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782727280.376702:0:7419:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e42a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c71e9f0f-6441-4b9b-bc96-153ab9250801:7419:1869324939701248:0@lo:502: 00000100:00100000:3.0:1782727280.376715:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782727280.376723:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c45e44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869324939701376:12345-0@lo:400: 00000020:01000000:2.0:1782727280.376730:0:7419:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782727280.376736:0:7419:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782727280.376738:0:7419:0:(obd_config.c:1561:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:2.0:1782727280.376741:0:7419:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:3.0:1782727280.376753:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c45e44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869324939701376:12345-0@lo:400: Request processed in 31us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727280.376759:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1782727280.376789:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1782727280.376811:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff921c45e45f80 x1869324939701376/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727280.376822:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3444:1869324939701376:0@lo:400: 00010000:00080000:3.0:1782727280.376835:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff921c45e44380 x1869324939701120/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727280.376845:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869324939701120:0@lo:400: 00000020:01000000:3.0:1782727280.376873:0:5946:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1782727280.376936:0:5946:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1782727280.376945:0:5946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff921c429d5c00/0x14a47870ee88ca62 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88ca69 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727280.376955:0:5946:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff921c429d5c00/0x14a47870ee88ca62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88ca69 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727280.376965:0:5946:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1782727280.376968:0:5946:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff921c519f0000 from 1 10000000:01000000:3.0:1782727280.376971:0:5946:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1782727280.376996:0:5946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff921c4151ca00/0x14a47870ee88ca85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727280.377005:0:5946:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff921c4151ca00/0x14a47870ee88ca85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727280.377014:0:5946:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff921c4151ca00/0x14a47870ee88ca85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727280.377027:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e44380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939701504:0@lo:101: 00000100:00100000:3.0:1782727280.377053:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727280.377086:0:5946:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c765a7480 going to sleep for 11 seconds 00000100:00100000:1.0:1782727280.377095:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939701504 00000100:00100000:1.0:1782727280.377100:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939701504 00000100:00100000:1.0:1782727280.377132:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1782727280.377139:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fe4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+15:5946:x1869324939701504:12345-0@lo:101: 00010000:00010000:1.0:1782727280.377147:0:5943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727280.377158:0:5943:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921c43a23800/0x14a47870ee88ca8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x14a47870ee88ca85 expref: -99 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727280.377178:0:5943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921c43a23800/0x14a47870ee88ca8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x14a47870ee88ca85 expref: 16 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727280.377187:0:5943:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921c43a23800/0x14a47870ee88ca8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x14a47870ee88ca85 expref: 16 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727280.377196:0:5943:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c43a23800, rc 0) 00000100:00100000:1.0:1782727280.377230:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fe4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+16:5946:x1869324939701504:12345-0@lo:101: Request processed in 92us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727280.377241:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1782727280.377559:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e44380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939701504:0@lo:101: 00010000:00010000:3.0:1782727280.377572:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff921c4151ca00/0x14a47870ee88ca85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88ca8c expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727280.377580:0:5946:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff921c4151ca00/0x14a47870ee88ca85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x14a47870ee88ca8c expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727280.377625:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e44380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939701632:0@lo:501: 00000100:00100000:3.0:1782727280.377662:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727280.377687:0:5946:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c765a7480 going to sleep for 11 seconds 00000100:00100000:1.0:1782727280.377720:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939701632 00000100:00100000:1.0:1782727280.377726:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939701632 00000100:00100000:1.0:1782727280.377758:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1782727280.377766:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fe4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+16:5946:x1869324939701632:12345-0@lo:501: 00000100:00100000:1.0:1782727280.377850:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fe4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+16:5946:x1869324939701632:12345-0@lo:501: Request processed in 84us (187us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782727280.377858:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1782727280.378089:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e44380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939701632:0@lo:501: 10000000:01000000:3.0:1782727280.378114:0:5946:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1782727280.378119:0:5946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff921c4151ca00/0x14a47870ee88ca85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88ca8c expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727280.378127:0:5946:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff921c4151ca00/0x14a47870ee88ca85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88ca8c expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727280.378211:0:3441:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3441:1869324939700992:0@lo:8: 00000100:00100000:0.0:1782727280.378247:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727280.378487:0:6949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939700992 00000100:00100000:2.0:1782727280.378492:0:6949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939700992 00000100:00100000:2.0:1782727280.378565:0:6949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782727280.378571:0:6949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c76440e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3441:x1869324939700992:12345-0@lo:8: 00010000:00080000:2.0:1782727280.378592:0:6949:0:(ldlm_lib.c:1434:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 175 last 0 00000020:00000080:2.0:1782727280.378618:0:6949:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x14a47870ee88ca93 00002000:00100000:2.0:1782727280.378706:0:6949:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff921c7670e800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1782727280.378719:0:6949:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:2.0:1782727280.378722:0:6949:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1782727280.378790:0:6949:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1782727280.379030:0:6949:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1782727280.379057:0:6949:0:(import.c:65:import_set_state_nolock()) ffff921c76709000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782727280.379123:0:6949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c76440e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3441:x1869324939700992:12345-0@lo:8: Request processed in 549us (873us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727280.379129:0:6949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1782727280.379212:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff921c45e43800 x1869324939700992/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782727290 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727280.379223:0:3441:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1782727280.379230:0:3441:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1782727280.379237:0:3441:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1782727280.379242:0:3441:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1782727280.379245:0:3441:0:(import.c:65:import_set_state_nolock()) ffff921c6ddda800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1782727280.379267:0:3441:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1782727280.379273:0:3441:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3441:1869324939700992:0@lo:8: 00000004:00080000:3.0:1782727280.379301:0:7420:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1782727280.379367:0:7420:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 175137483069ns, next at 0ns, rc = 0 00080000:00080000:3.0:1782727280.379375:0:7420:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1782727280.381289:0:5929:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:2.0:1782727280.382611:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000004:00080000:1.0:1782727280.382754:0:7421:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1782727280.382858:0:7421:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c6e380a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7421:1869324939701888:0@lo:7: 00000100:00100000:1.0:1782727280.382977:0:7421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727280.383020:0:7421:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c46407f00 going to sleep for 11 seconds 00000100:00100000:3.0:1782727280.383134:0:6951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939701888 00000100:00100000:3.0:1782727280.383141:0:6951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939701888 00000100:00100000:3.0:1782727280.383216:0:6951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782727280.383226:0:6951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6e380e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7421:x1869324939701888:12345-0@lo:7: 00000100:00080000:0.0:1782727280.383589:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782727280.384664:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c6e382300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869324939701760:0@lo:13: 00000100:00100000:2.0:1782727280.384730:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727280.388966:0:6952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939701760 00000100:00100000:0.0:1782727280.388982:0:6952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939701760 00000100:00100000:0.0:1782727280.389034:0:6952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782727280.389044:0:6952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c45e42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3443:x1869324939701760:12345-0@lo:13: 00002000:00000024:0.0:1782727280.389078:0:6952:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923881984 avail 3692359680 00002000:00080000:2.0:1782727280.396708:0:6951:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1782727280.396718:0:6951:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1782727280.397054:0:6951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6e380e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:7421:x1869324939701888:12345-0@lo:7: Request processed in 13825us (14072us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727280.397065:0:6951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782727280.397175:0:6952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c45e42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3443:x1869324939701760:12345-0@lo:13: Request processed in 8131us (12444us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727280.397185:0:6952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1782727280.400151:0:7421:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff921c6e380a80 x1869324939701888/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1782727296 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727280.400170:0:7421:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c6e380a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7421:1869324939701888:0@lo:7: 00000004:00080000:1.0:1782727280.400184:0:7421:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1782727280.400227:0:7421:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c6e380a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7421:1869324939702016:0@lo:5: 00000100:00100000:1.0:1782727280.400280:0:7421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727280.400348:0:7421:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c46407f00 going to sleep for 11 seconds 00000100:00100000:2.0:1782727280.400406:0:6949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939702016 00000100:00100000:2.0:1782727280.400413:0:6949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939702016 00000100:00100000:2.0:1782727280.400468:0:6949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782727280.400478:0:6949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6e383800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7421:x1869324939702016:12345-0@lo:5: 00002000:00080000:2.0:1782727280.400507:0:6949:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1782727280.400513:0:6949:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00010000:00080000:3.0:1782727280.403131:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff921c6e382300 x1869324939701760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727296 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727280.403166:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c6e382300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869324939701760:0@lo:13: 00000001:00080000:0.0:1782727280.405048:0:6943:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:0.0:1782727280.405080:0:6943:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1782727280.405239:0:6949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6e383800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:7421:x1869324939702016:12345-0@lo:5: Request processed in 4760us (4956us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1782727280.405249:0:6949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1782727280.405356:0:7421:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff921c6e380a80 x1869324939702016/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782727296 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727280.405367:0:7421:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1782727280.405373:0:7421:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c6e380a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7421:1869324939702016:0@lo:5: 00000004:00080000:1.0:1782727280.405388:0:7421:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1782727280.405447:0:7421:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c6e380a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7421:1869324939702144:0@lo:700: 00000100:00100000:1.0:1782727280.405483:0:7421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727280.405527:0:7421:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c46407f00 going to sleep for 11 seconds 00000100:00100000:0.0:1782727280.405936:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939702144 00000100:00100000:0.0:1782727280.405943:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939702144 00000100:00100000:0.0:1782727280.405977:0:6957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782727280.405986:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6e382a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7421:x1869324939702144:12345-0@lo:700: 00000100:00100000:0.0:1782727280.406021:0:6957:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c76443100 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6957:1869324939702272:0@lo:700: 00000100:00100000:0.0:1782727280.406050:0:6957:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727280.406075:0:6957:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c52211300 going to sleep for 11 seconds 00000100:00100000:3.0:1782727280.406191:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939702272 00000100:00100000:3.0:1782727280.406195:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939702272 00000100:00100000:3.0:1782727280.406226:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782727280.406233:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c76441880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6957:x1869324939702272:12345-0@lo:700: 40000000:02000000:3.0:1782727280.414519:0:5956:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:3.0:1782727280.424529:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c76441880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6957:x1869324939702272:12345-0@lo:700: Request processed in 18288us (18469us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727280.424544:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1782727280.424812:0:6957:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff921c76443100 x1869324939702272/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1782727296 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727280.424827:0:6957:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c76443100 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6957:1869324939702272:0@lo:700: 40000000:02000000:0.0:1782727280.424840:0:6957:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:1.0:1782727280.455756:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6e382a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7421:x1869324939702144:12345-0@lo:700: Request processed in 49762us (50264us total) trans 0 rc 0/0 00010000:00080000:0.0:1782727280.455860:0:7421:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff921c6e380a80 x1869324939702144/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1782727296 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727280.455876:0:7421:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c6e380a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7421:1869324939702144:0@lo:700: 00000100:00100000:1.0:1782727280.456039:0:6957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000004:02000040:1.0:1782727280.463719:0:7421:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:1.0:1782727280.467739:0:7421:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c6e382d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7421:1869324939702400:0@lo:5: 00000100:00100000:1.0:1782727280.468058:0:7421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727280.468128:0:7421:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c46407f00 going to sleep for 11 seconds 00000100:00100000:2.0:1782727280.468211:0:6951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939702400 00000100:00100000:2.0:1782727280.468219:0:6951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939702400 00000100:00100000:2.0:1782727280.468275:0:6951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782727280.468284:0:6951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6e380380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7421:x1869324939702400:12345-0@lo:5: 00002000:00080000:2.0:1782727280.474248:0:6951:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1782727280.474268:0:6951:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:2.0:1782727280.476124:0:6951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6e380380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7421:x1869324939702400:12345-0@lo:5: Request processed in 7835us (8060us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1782727280.476136:0:6951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1782727280.476852:0:7421:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff921c6e382d80 x1869324939702400/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782727296 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727280.476871:0:7421:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c6e382d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7421:1869324939702400:0@lo:5: 00000004:00080000:0.0:1782727280.476912:0:7421:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00000001:00080000:0.0:1782727280.939371:0:6943:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1782727281.082984:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1782727281.925595:0:7471:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1782727281.925809:0:7471:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1782727282.106143:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1782727282.844403:0:7519:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1782727282.844413:0:7519:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:2.0:1782727283.129180:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727284.155280:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727285.177252:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727285.433539:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869324939702656:0@lo:400: 00000100:00100000:3.0:1782727285.433656:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727285.433713:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782727285.433720:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3444:1869324939702784:0@lo:400: 00000100:00100000:3.0:1782727285.433769:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727285.433805:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939702656 00000100:00100000:3.0:1782727285.433811:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939702656 00000100:00100000:3.0:1782727285.433849:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939702784 00000100:00100000:3.0:1782727285.433853:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939702784 00000100:00100000:3.0:1782727285.433879:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782727285.433917:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c45e45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869324939702656:12345-0@lo:400: 00000100:00100000:3.0:1782727285.433971:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c45e45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869324939702656:12345-0@lo:400: Request processed in 66us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727285.433978:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782727285.433995:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1782727285.434016:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c45e46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869324939702784:12345-0@lo:400: 00000100:00100000:3.0:1782727285.434043:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c45e46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869324939702784:12345-0@lo:400: Request processed in 30us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727285.434049:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1782727285.434071:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1782727285.434098:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff921c45e47480 x1869324939702784/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727285.434113:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3444:1869324939702784:0@lo:400: 00010000:00080000:3.0:1782727285.434124:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff921c45e45f80 x1869324939702656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727285.434133:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869324939702656:0@lo:400: 00000100:00100000:2.0:1782727285.434316:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c71e9f0f-6441-4b9b-bc96-153ab9250801:3443:1869324939702528:0@lo:400: 00000100:00100000:2.0:1782727285.434355:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727285.434406:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782727285.434413:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869324939702912:0@lo:400: 00000100:00100000:2.0:1782727285.434437:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727285.434463:0:6949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939702912 00000100:00100000:2.0:1782727285.434467:0:6949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939702912 00000100:00100000:2.0:1782727285.434503:0:6949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782727285.434510:0:6949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c45e42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3443:x1869324939702912:12345-0@lo:400: 00000100:00100000:2.0:1782727285.434543:0:6949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c45e42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3443:x1869324939702912:12345-0@lo:400: Request processed in 34us (105us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727285.434549:0:6949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1782727285.434566:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1782727285.434581:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff921c45e44000 x1869324939702912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727285.434589:0:3443:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1782727285.434601:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869324939702912:0@lo:400: 00000100:00100000:3.0:1782727285.437322:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939702528 00000100:00100000:3.0:1782727285.437337:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939702528 00000100:00100000:3.0:1782727285.437406:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1782727285.437417:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fdb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+16:3443:x1869324939702528:12345-0@lo:400: 00000100:00100000:3.0:1782727285.438131:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fdb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+16:3443:x1869324939702528:12345-0@lo:400: Request processed in 715us (3773us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727285.438140:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1782727285.438716:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c71e9f0f-6441-4b9b-bc96-153ab9250801:3443:1869324939702528:0@lo:400: 00000100:00100000:2.0:1782727285.440620:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c76443100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869324939703040:0@lo:13: 00000100:00100000:2.0:1782727285.440670:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727285.440836:0:6953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939703040 00000100:00100000:0.0:1782727285.440964:0:6953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939703040 00000100:00100000:0.0:1782727285.441016:0:6953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782727285.441025:0:6953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c45e40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1869324939703040:12345-0@lo:13: 00002000:00000024:0.0:1782727285.441061:0:6953:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1782727285.441157:0:6953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c45e40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1869324939703040:12345-0@lo:13: Request processed in 133us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727285.441162:0:6953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1782727285.445605:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff921c76443100 x1869324939703040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727301 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727285.445630:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c76443100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869324939703040:0@lo:13: 00010000:00010000:0.0:1782727286.201998:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727287.227457:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727288.251199:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727289.273556:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727290.298929:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727290.555751:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869324939703168:0@lo:13: 00000100:00100000:2.0:1782727290.555822:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727290.555917:0:6952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939703168 00000100:00100000:2.0:1782727290.555924:0:6952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939703168 00000100:00100000:2.0:1782727290.555976:0:6952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782727290.555985:0:6952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c45e41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324939703168:12345-0@lo:13: 00002000:00000024:2.0:1782727290.556015:0:6952:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1782727290.556095:0:6952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c45e41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324939703168:12345-0@lo:13: Request processed in 111us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727290.556103:0:6952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1782727290.556123:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1782727290.556152:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff921c45e43100 x1869324939703168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727306 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727290.556168:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869324939703168:0@lo:13: 00000100:00100000:1.0:1782727290.556847:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c6e382d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3442:1869324939703424:0@lo:400: 00000100:00100000:1.0:1782727290.556936:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727290.556960:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782727290.556966:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c6e380a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3442:1869324939703552:0@lo:400: 00000100:00100000:1.0:1782727290.556991:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727290.557016:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939703424 00000100:00100000:1.0:1782727290.557020:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939703424 00000100:00100000:1.0:1782727290.557047:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939703552 00000100:00100000:1.0:1782727290.557050:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939703552 00000100:00100000:1.0:1782727290.557070:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782727290.557076:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6e382300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1869324939703424:12345-0@lo:400: 00000100:00100000:1.0:1782727290.557112:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6e382300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1869324939703424:12345-0@lo:400: Request processed in 36us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727290.557118:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782727290.557145:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782727290.557152:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6e383b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1869324939703552:12345-0@lo:400: 00000100:00100000:1.0:1782727290.557181:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6e383b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1869324939703552:12345-0@lo:400: Request processed in 31us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727290.557187:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1782727290.557220:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff921c6e380a80 x1869324939703552/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727290.557230:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c6e380a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3442:1869324939703552:0@lo:400: 00010000:00080000:1.0:1782727290.557240:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff921c6e382d80 x1869324939703424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727290.557248:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c6e382d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3442:1869324939703424:0@lo:400: 00000100:00100000:2.0:1782727290.557411:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c6e383100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c71e9f0f-6441-4b9b-bc96-153ab9250801:3445:1869324939703296:0@lo:400: 00000100:00100000:2.0:1782727290.557449:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1782727290.557492:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782727290.559431:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939703296 00000100:00100000:1.0:1782727290.559444:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939703296 00000100:00100000:1.0:1782727290.559499:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1782727290.559509:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fdb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+16:3445:x1869324939703296:12345-0@lo:400: 00000100:00100000:1.0:1782727290.559584:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fdb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+16:3445:x1869324939703296:12345-0@lo:400: Request processed in 77us (2134us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727290.559591:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1782727290.560460:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c6e383100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c71e9f0f-6441-4b9b-bc96-153ab9250801:3445:1869324939703296:0@lo:400: 00010000:00010000:1.0:1782727291.328981:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1782727291.915635:0:8017:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:3.0:1782727291.915641:0:8017:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1782727291.915643:0:8017:0:(obd_mount.c:920:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1782727291.916172:0:8017:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff921c7d8c0800 00000020:01000004:3.0:1782727291.916189:0:8017:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1782727291.916201:0:8017:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1782727291.916214:0:8017:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff921c765699d0) 00000020:00000080:3.0:1782727291.916234:0:8017:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1782727292.002761:0:8017:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1782727292.002875:0:8017:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:1.0:1782727292.055623:0:8017:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1782727292.056591:0:8017:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1782727292.056605:0:8017:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:1.0:1782727292.056617:0:8017:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x14a47870ee88caa1 00000020:01000004:1.0:1782727292.056624:0:8017:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1782727292.056645:0:8017:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.202.160@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1782727292.056648:0:8017:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.160@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1782727292.056653:0:8017:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1782727292.057503:0:8017:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1782727292.057510:0:8017:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.160@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1782727292.120464:0:8017:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.160@tcp ctxt 0 is initialized 00000020:01000004:3.0:1782727292.120501:0:8017:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.160@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1782727292.120505:0:8017:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1782727292.120507:0:8017:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1782727292.120508:0:8017:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782727292.120509:0:8017:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782727292.120511:0:8017:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782727292.120512:0:8017:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782727292.120514:0:8017:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782727292.120515:0:8017:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1782727292.120516:0:8017:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1782727292.120518:0:8017:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782727292.120519:0:8017:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1782727292.120522:0:8017:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1782727292.120524:0:8017:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1782727292.120525:0:8017:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1782727292.120527:0:8017:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782727292.120527:0:8017:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782727292.120529:0:8017:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782727292.120530:0:8017:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782727292.120531:0:8017:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782727292.120532:0:8017:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1782727292.120533:0:8017:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1782727292.120534:0:8017:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782727292.120535:0:8017:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1782727292.120559:0:8017:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1782727292.120578:0:8017:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e45f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:8017:1869324939703680:0@lo:253: 00000100:00100000:3.0:1782727292.120647:0:8017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727292.120698:0:8017:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c7667ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1782727292.120942:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939703680 00000100:00100000:2.0:1782727292.120958:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939703680 00000100:00100000:2.0:1782727292.121010:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1782727292.121020:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fdb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+16:8017:x1869324939703680:12345-0@lo:253: 20000000:01000000:2.0:1782727292.121057:0:5944:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1782727292.121061:0:5944:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1782727292.121066:0:5944:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1782727292.121070:0:5944:0:(mgs_llog.c:3853:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1782727292.121265:0:5944:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782727292.121398:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1782727292.121412:0:5944:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1782727292.121430:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1782727292.121436:0:5944:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1782727292.121448:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1782727292.121463:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1782727292.121544:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1782727292.121559:0:5944:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.202.160@tcp 20000000:01000000:2.0:1782727292.121561:0:5944:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.202.160@tcp (null) (null) (null) 00000040:00080000:2.0:1782727292.121575:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1782727292.121581:0:5944:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1782727292.121594:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1782727292.121599:0:5944:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.160@tcp (null) (null) 00000040:00080000:2.0:1782727292.121609:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1782727292.121615:0:5944:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1782727292.121627:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1782727292.121641:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1782727292.122024:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:2.0:1782727292.122037:0:5944:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.202.160@tcp 20000000:01000000:2.0:1782727292.122039:0:5944:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.202.160@tcp (null) (null) (null) 00000040:00080000:2.0:1782727292.122053:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:2.0:1782727292.122060:0:5944:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1782727292.122073:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:2.0:1782727292.122087:0:5944:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.160@tcp (null) (null) 00000040:00080000:2.0:1782727292.122104:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:2.0:1782727292.122110:0:5944:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1782727292.122123:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:2.0:1782727292.122137:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:2.0:1782727292.122151:0:5944:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1782727292.122153:0:5944:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1782727292.122157:0:5944:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1782727292.122199:0:5944:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1782727292.122202:0:5944:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1782727292.124387:0:8023:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1782727292.124435:0:8023:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1782727292.124456:0:8023:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1782727292.124811:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1782727292.124838:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1782727292.124854:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1782727292.124867:0:5944:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1782727292.124869:0:5944:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1782727292.125583:0:8024:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1782727292.125608:0:8024:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1782727292.125643:0:8024:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1782727292.126037:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:3.0:1782727292.126059:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:3.0:1782727292.126088:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:3.0:1782727292.126099:0:5944:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1782727292.126101:0:5944:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1782727292.126453:0:8025:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1782727292.126480:0:8025:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1782727292.126491:0:8025:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:2.0:1782727292.126730:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:2.0:1782727292.126765:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:2.0:1782727292.126785:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:2.0:1782727292.126796:0:5944:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1782727292.126798:0:5944:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1782727292.127649:0:8026:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1782727292.127858:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1782727292.127915:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1782727292.127934:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 10000000:01000000:3.0:1782727292.127954:0:5944:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1782727292.127973:0:5944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff921c4151c600/0x14a47870ee88caa8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727292.127990:0:5944:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff921c7a3e0e00/0x14a47870ee88c9f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x14a47870ee88c9f2 expref: 16 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727292.127999:0:5944:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff921c43a22800/0x14a47870ee88ca23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x14a47870ee88ca1c expref: 16 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727292.128005:0:5944:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff921c43a22c00/0x14a47870ee88ca4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x14a47870ee88ca46 expref: 16 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727292.128012:0:5944:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff921c4151c000/0x14a47870ee88ca69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x14a47870ee88ca62 expref: 16 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727292.128019:0:5944:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff921c43a23800/0x14a47870ee88ca8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x14a47870ee88ca85 expref: 16 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727292.128027:0:5944:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff921c4151c600/0x14a47870ee88caa8 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727292.128065:0:5944:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff921c43a23800/0x14a47870ee88ca8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x14a47870ee88ca85 expref: 16 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727292.128087:0:5944:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff921c43a23800/0x14a47870ee88ca8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x14a47870ee88ca85 expref: 16 pid: 5943 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727292.128102:0:5944:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e47480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5944:1869324939703808:0@lo:104: 00000100:00100000:3.0:1782727292.128175:0:5944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782727292.128220:0:5944:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff921c4151c000/0x14a47870ee88ca69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x14a47870ee88ca62 expref: 16 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727292.128228:0:5944:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff921c4151c000/0x14a47870ee88ca69 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x14a47870ee88ca62 expref: 16 pid: 5942 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727292.128248:0:5944:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e47800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5944:1869324939703936:0@lo:104: 00010000:00010000:3.0:1782727292.128275:0:5944:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff921c43a22c00/0x14a47870ee88ca4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x14a47870ee88ca46 expref: 16 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727292.128283:0:5944:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff921c43a22c00/0x14a47870ee88ca4d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x14a47870ee88ca46 expref: 16 pid: 5942 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727292.128291:0:5944:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e44a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5944:1869324939704064:0@lo:104: 00010000:00010000:3.0:1782727292.128315:0:5944:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff921c43a22800/0x14a47870ee88ca23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x14a47870ee88ca1c expref: 16 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727292.128323:0:5944:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff921c43a22800/0x14a47870ee88ca23 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x14a47870ee88ca1c expref: 16 pid: 5942 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727292.128331:0:5944:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e45180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5944:1869324939704192:0@lo:104: 00010000:00010000:3.0:1782727292.128353:0:5944:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff921c7a3e0e00/0x14a47870ee88c9f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x14a47870ee88c9f2 expref: 16 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727292.128372:0:5944:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff921c7a3e0e00/0x14a47870ee88c9f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x14a47870ee88c9f2 expref: 16 pid: 5943 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727292.128381:0:5944:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e46680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5944:1869324939704320:0@lo:104: 00000100:00100000:3.0:1782727292.128401:0:5944:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c6e342240 going to sleep for 11 seconds 00000100:00100000:2.0:1782727292.128597:0:5932:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1782727292.128615:0:5932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727292.128634:0:5932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727292.128643:0:5932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727292.128652:0:5932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727292.128661:0:5932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939703808 00000100:00100000:2.0:1782727292.128667:0:5932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939703808 00000100:00100000:2.0:1782727292.128706:0:5932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939703936 00000100:00100000:2.0:1782727292.128710:0:5932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939703936 00000100:00100000:2.0:1782727292.128718:0:5932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939704064 00000100:00100000:2.0:1782727292.128720:0:5932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939704064 00000100:00100000:2.0:1782727292.128728:0:5932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939704192 00000100:00100000:2.0:1782727292.128730:0:5932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939704192 00000100:00100000:2.0:1782727292.128739:0:5932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939704320 00000100:00100000:2.0:1782727292.128741:0:5932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939704320 00000100:00100000:2.0:1782727292.128753:0:5932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782727292.128761:0:5932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6e368050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c71e9f0f-6441-4b9b-bc96-153ab9250801+7:5944:x1869324939703808:12345-0@lo:104: 00010000:00010000:2.0:1782727292.128778:0:5932:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.160@tcp lock: ffff921c4151ca00/0x14a47870ee88ca85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x14a47870ee88ca8c expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727292.128929:0:5944:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e47480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5944:1869324939703808:0@lo:104: 00010000:00010000:2.0:1782727292.129216:0:5932:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782727292.129223:0:5932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6e368050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c71e9f0f-6441-4b9b-bc96-153ab9250801+7:5944:x1869324939703808:12345-0@lo:104: Request processed in 462us (1049us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727292.129231:0:5932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782727292.129279:0:5932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782727292.129287:0:5932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c45e43100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c71e9f0f-6441-4b9b-bc96-153ab9250801+6:5944:x1869324939703936:12345-0@lo:104: 00010000:00010000:2.0:1782727292.129294:0:5932:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.160@tcp lock: ffff921c429d5c00/0x14a47870ee88ca62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x14a47870ee88ca69 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727292.129377:0:5944:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e47800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5944:1869324939703936:0@lo:104: 00010000:00010000:1.0:1782727292.132157:0:5937:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782727292.132172:0:5937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff921c4151ca00/0x14a47870ee88ca85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x14a47870ee88ca8c expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727292.132184:0:5937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c4151ca00 already unused, calling callback (ffffffffc12b0c20) 10000000:00010000:1.0:1782727292.132188:0:5937:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff921c4151ca00/0x14a47870ee88ca85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x14a47870ee88ca8c expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727292.132199:0:5937:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff921c4151ca00/0x14a47870ee88ca85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x14a47870ee88ca8c expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782727292.132206:0:5937:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff921c4151ca00/0x14a47870ee88ca85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x14a47870ee88ca8c expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782727292.132213:0:5937:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782727292.132310:0:5937:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff921c4151ca00/0x14a47870ee88ca85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x14a47870ee88ca8c expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727292.132316:0:5937:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782727292.132348:0:5937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff921c4151ca00/0x14a47870ee88ca85 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x14a47870ee88ca8c expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727292.132354:0:5937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff921c4151ca00/0x14a47870ee88ca85 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x14a47870ee88ca8c expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727292.132382:0:5937:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782727292.132385:0:5937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff921c429d5c00/0x14a47870ee88ca62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x14a47870ee88ca69 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727292.132391:0:5937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c429d5c00 already unused, calling callback (ffffffffc12b0c20) 10000000:00010000:1.0:1782727292.132393:0:5937:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff921c429d5c00/0x14a47870ee88ca62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x14a47870ee88ca69 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727292.132400:0:5937:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff921c429d5c00/0x14a47870ee88ca62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x14a47870ee88ca69 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782727292.132405:0:5937:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff921c429d5c00/0x14a47870ee88ca62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x14a47870ee88ca69 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782727292.132410:0:5937:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1782727292.132463:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c6e382d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c71e9f0f-6441-4b9b-bc96-153ab9250801:3444:1869324939704448:0@lo:103: 00000100:00100000:0.0:1782727292.132530:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727292.132594:0:5935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939704448 00000100:00100000:0.0:1782727292.132601:0:5935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939704448 00010000:00010000:0.0:1782727292.132631:0:5935:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff921c43a23800/0x14a47870ee88ca8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x14a47870ee88ca85 expref: 17 pid: 5943 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727292.132659:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782727292.132668:0:5935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c76441500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c71e9f0f-6441-4b9b-bc96-153ab9250801+17:3444:x1869324939704448:12345-0@lo:103: 00010000:00010000:0.0:1782727292.132693:0:5935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782727292.132699:0:5935:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff921c43a23800/0x14a47870ee88ca8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x14a47870ee88ca85 expref: 17 pid: 5943 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727292.132711:0:5935:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff921c43a23800/0x14a47870ee88ca8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x14a47870ee88ca85 expref: 17 pid: 5943 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727292.132726:0:5935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921c43a23800/0x14a47870ee88ca8c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x14a47870ee88ca85 expref: 17 pid: 5943 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727292.132739:0:5935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782727292.132774:0:5935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c76441500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c71e9f0f-6441-4b9b-bc96-153ab9250801+16:3444:x1869324939704448:12345-0@lo:103: Request processed in 107us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727292.132781:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782727292.132837:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c6e382d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c71e9f0f-6441-4b9b-bc96-153ab9250801:3444:1869324939704448:0@lo:103: 00010000:00010000:2.0:1782727292.133266:0:5932:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1782727292.133276:0:5932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c45e43100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c71e9f0f-6441-4b9b-bc96-153ab9250801+6:5944:x1869324939703936:12345-0@lo:104: Request processed in 3990us (4659us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727292.133284:0:5932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782727292.133305:0:5932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1782727292.133312:0:5932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c45e41c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c71e9f0f-6441-4b9b-bc96-153ab9250801+5:5944:x1869324939704064:12345-0@lo:104: 00010000:00010000:2.0:1782727292.133322:0:5932:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.160@tcp lock: ffff921c7a3e0a00/0x14a47870ee88ca46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x14a47870ee88ca4d expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727292.133369:0:5932:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782727292.133373:0:5932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c45e41c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c71e9f0f-6441-4b9b-bc96-153ab9250801+5:5944:x1869324939704064:12345-0@lo:104: Request processed in 63us (4739us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727292.133378:0:5932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1782727292.133389:0:5932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1782727292.133394:0:5932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c45e43800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c71e9f0f-6441-4b9b-bc96-153ab9250801+4:5944:x1869324939704192:12345-0@lo:104: 00010000:00010000:2.0:1782727292.133409:0:5932:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.160@tcp lock: ffff921c4151d200/0x14a47870ee88ca1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x14a47870ee88ca23 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727292.133436:0:5932:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1782727292.133441:0:5932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c45e43800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c71e9f0f-6441-4b9b-bc96-153ab9250801+4:5944:x1869324939704192:12345-0@lo:104: Request processed in 47us (4797us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727292.133446:0:5932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1782727292.133458:0:5932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1782727292.133464:0:5932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c45e40e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c71e9f0f-6441-4b9b-bc96-153ab9250801+3:5944:x1869324939704320:12345-0@lo:104: 00010000:00010000:2.0:1782727292.133471:0:5932:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.160@tcp lock: ffff921c43a23c00/0x14a47870ee88c9f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x14a47870ee88c9f9 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727292.133501:0:5932:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1782727292.133506:0:5932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c45e40e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c71e9f0f-6441-4b9b-bc96-153ab9250801+3:5944:x1869324939704320:12345-0@lo:104: Request processed in 44us (4854us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727292.133511:0:5932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1782727292.133554:0:5944:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e44a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5944:1869324939704064:0@lo:104: 00000100:00100000:2.0:1782727292.133564:0:5944:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e45180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5944:1869324939704192:0@lo:104: 00000100:00100000:2.0:1782727292.133571:0:5944:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e46680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5944:1869324939704320:0@lo:104: 00010000:00010000:2.0:1782727292.133596:0:5944:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff921c4151c600/0x14a47870ee88caa8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727292.133684:0:5938:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1782727292.136126:0:5937:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff921c429d5c00/0x14a47870ee88ca62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x14a47870ee88ca69 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727292.136140:0:5937:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1782727292.136184:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1782727292.136203:0:5937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff921c429d5c00/0x14a47870ee88ca62 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x14a47870ee88ca69 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727292.136211:0:5937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff921c429d5c00/0x14a47870ee88ca62 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x14a47870ee88ca69 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727292.136229:0:5937:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782727292.136233:0:5937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff921c4151d200/0x14a47870ee88ca1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x14a47870ee88ca23 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727292.136266:0:5937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c4151d200 already unused, calling callback (ffffffffc12b0c20) 10000000:00010000:1.0:1782727292.136270:0:5937:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff921c4151d200/0x14a47870ee88ca1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x14a47870ee88ca23 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727292.136280:0:5937:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff921c4151d200/0x14a47870ee88ca1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x14a47870ee88ca23 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782727292.136286:0:5937:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff921c4151d200/0x14a47870ee88ca1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x14a47870ee88ca23 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782727292.136291:0:5937:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782727292.136309:0:5937:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff921c4151d200/0x14a47870ee88ca1c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x14a47870ee88ca23 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727292.136314:0:5937:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782727292.136330:0:5937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff921c4151d200/0x14a47870ee88ca1c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x14a47870ee88ca23 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727292.136336:0:5937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff921c4151d200/0x14a47870ee88ca1c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x14a47870ee88ca23 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727292.136345:0:5937:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782727292.136348:0:5937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff921c43a23c00/0x14a47870ee88c9f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x14a47870ee88c9f9 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727292.136353:0:5937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c43a23c00 already unused, calling callback (ffffffffc12b0c20) 10000000:00010000:1.0:1782727292.136356:0:5937:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff921c43a23c00/0x14a47870ee88c9f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x14a47870ee88c9f9 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727292.136371:0:5937:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff921c43a23c00/0x14a47870ee88c9f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x14a47870ee88c9f9 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782727292.136377:0:5937:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff921c43a23c00/0x14a47870ee88c9f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x14a47870ee88c9f9 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782727292.136382:0:5937:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782727292.136394:0:5937:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff921c43a23c00/0x14a47870ee88c9f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x14a47870ee88c9f9 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727292.136400:0:5937:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782727292.136406:0:5937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff921c43a23c00/0x14a47870ee88c9f2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x14a47870ee88c9f9 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727292.136411:0:5937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff921c43a23c00/0x14a47870ee88c9f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x14a47870ee88c9f9 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727292.136420:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727292.136422:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727292.136423:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727292.136444:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c6e381180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c71e9f0f-6441-4b9b-bc96-153ab9250801:3442:1869324939704704:0@lo:103: 00000100:00100000:1.0:1782727292.136504:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727292.136547:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782727292.136553:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c6e382680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c71e9f0f-6441-4b9b-bc96-153ab9250801:3442:1869324939704832:0@lo:103: 00000100:00100000:1.0:1782727292.136572:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727292.136606:0:5934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939704704 00000100:00100000:1.0:1782727292.136614:0:5934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939704704 00010000:00010000:1.0:1782727292.136638:0:5934:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff921c43a22800/0x14a47870ee88ca23 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x14a47870ee88ca1c expref: 16 pid: 5942 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727292.136784:0:5934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939704832 00000100:00100000:1.0:1782727292.136788:0:5934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939704832 00010000:00010000:1.0:1782727292.136801:0:5934:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff921c7a3e0e00/0x14a47870ee88c9f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x14a47870ee88c9f2 expref: 17 pid: 5943 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727292.136817:0:5934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782727292.136824:0:5934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6e381500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c71e9f0f-6441-4b9b-bc96-153ab9250801+17:3442:x1869324939704704:12345-0@lo:103: 00010000:00010000:1.0:1782727292.136837:0:5934:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782727292.136842:0:5934:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff921c43a22800/0x14a47870ee88ca23 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x14a47870ee88ca1c expref: 17 pid: 5942 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727292.136852:0:5934:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff921c43a22800/0x14a47870ee88ca23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x14a47870ee88ca1c expref: 17 pid: 5942 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727292.136866:0:5934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921c43a22800/0x14a47870ee88ca23 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x14a47870ee88ca1c expref: 17 pid: 5942 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727292.136877:0:5934:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782727292.137088:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727292.137097:0:5938:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff921c7a3e0a00/0x14a47870ee88ca46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x14a47870ee88ca4d expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727292.137103:0:5938:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c7a3e0a00 already unused, calling callback (ffffffffc12b0c20) 10000000:00010000:0.0:1782727292.137106:0:5938:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff921c7a3e0a00/0x14a47870ee88ca46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x14a47870ee88ca4d expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727292.137114:0:5938:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff921c7a3e0a00/0x14a47870ee88ca46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x14a47870ee88ca4d expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782727292.137119:0:5938:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff921c7a3e0a00/0x14a47870ee88ca46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x14a47870ee88ca4d expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782727292.137124:0:5938:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782727292.137147:0:5938:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff921c7a3e0a00/0x14a47870ee88ca46 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x14a47870ee88ca4d expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727292.137152:0:5938:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1782727292.137204:0:5934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6e381500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c71e9f0f-6441-4b9b-bc96-153ab9250801+16:3442:x1869324939704704:12345-0@lo:103: Request processed in 379us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727292.137211:0:5934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782727292.137228:0:5934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1782727292.137234:0:5934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6e380000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c71e9f0f-6441-4b9b-bc96-153ab9250801+15:3442:x1869324939704832:12345-0@lo:103: 00010000:00010000:1.0:1782727292.137253:0:5934:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782727292.137258:0:5934:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff921c7a3e0e00/0x14a47870ee88c9f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x14a47870ee88c9f2 expref: 15 pid: 5943 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727292.137265:0:5934:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff921c7a3e0e00/0x14a47870ee88c9f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x14a47870ee88c9f2 expref: 15 pid: 5943 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727292.137281:0:5934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921c7a3e0e00/0x14a47870ee88c9f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x14a47870ee88c9f2 expref: 15 pid: 5943 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727292.137288:0:5934:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782727292.137311:0:5934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6e380000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c71e9f0f-6441-4b9b-bc96-153ab9250801+14:3442:x1869324939704832:12345-0@lo:103: Request processed in 78us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727292.137318:0:5934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1782727292.137352:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c6e382680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c71e9f0f-6441-4b9b-bc96-153ab9250801:3442:1869324939704832:0@lo:103: 00000100:00100000:1.0:1782727292.137360:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c6e381180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c71e9f0f-6441-4b9b-bc96-153ab9250801:3442:1869324939704704:0@lo:103: 00000100:00100000:2.0:1782727292.137479:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c76442680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c71e9f0f-6441-4b9b-bc96-153ab9250801:3444:1869324939704960:0@lo:103: 00000100:00100000:2.0:1782727292.137508:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727292.137539:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c6e380a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c71e9f0f-6441-4b9b-bc96-153ab9250801:3444:1869324939704576:0@lo:103: 00000100:00100000:2.0:1782727292.137557:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727292.137631:0:5934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939704960 00000100:00100000:1.0:1782727292.137636:0:5934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939704960 00010000:00010000:1.0:1782727292.137652:0:5934:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff921c43a22c00/0x14a47870ee88ca4d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x14a47870ee88ca46 expref: 14 pid: 5942 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727292.137683:0:5934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939704576 00000100:00100000:1.0:1782727292.137687:0:5934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939704576 00010000:00010000:1.0:1782727292.137697:0:5934:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff921c4151c000/0x14a47870ee88ca69 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x14a47870ee88ca62 expref: 15 pid: 5942 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727292.137708:0:5934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782727292.137713:0:5934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c45e41880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c71e9f0f-6441-4b9b-bc96-153ab9250801+15:3444:x1869324939704960:12345-0@lo:103: 00010000:00010000:1.0:1782727292.137720:0:5934:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782727292.137723:0:5934:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff921c43a22c00/0x14a47870ee88ca4d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x14a47870ee88ca46 expref: 15 pid: 5942 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727292.137731:0:5934:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff921c43a22c00/0x14a47870ee88ca4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x14a47870ee88ca46 expref: 15 pid: 5942 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727292.137749:0:5934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921c43a22c00/0x14a47870ee88ca4d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x14a47870ee88ca46 expref: 15 pid: 5942 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727292.137759:0:5934:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782727292.137788:0:5934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c45e41880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c71e9f0f-6441-4b9b-bc96-153ab9250801+14:3444:x1869324939704960:12345-0@lo:103: Request processed in 74us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727292.137794:0:5934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782727292.137809:0:5934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782727292.137815:0:5934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c45e41500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c71e9f0f-6441-4b9b-bc96-153ab9250801+13:3444:x1869324939704576:12345-0@lo:103: 00010000:00010000:1.0:1782727292.137823:0:5934:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782727292.137828:0:5934:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff921c4151c000/0x14a47870ee88ca69 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x14a47870ee88ca62 expref: 13 pid: 5942 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727292.137836:0:5934:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff921c4151c000/0x14a47870ee88ca69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x14a47870ee88ca62 expref: 13 pid: 5942 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727292.137844:0:5934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921c4151c000/0x14a47870ee88ca69 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x14a47870ee88ca62 expref: 13 pid: 5942 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727292.137853:0:5934:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff921c4151c600/0x14a47870ee88caa8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727292.137859:0:5934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921c4151c600/0x14a47870ee88caa8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727292.137872:0:5934:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff921c4151c600/0x14a47870ee88caa8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727292.137878:0:5934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff921c4151c600/0x14a47870ee88caa8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727292.137950:0:5934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff921c4151c600/0x14a47870ee88caa8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727292.137956:0:5934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff921c4151c600/0x14a47870ee88caa8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727292.137961:0:5934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c4151c600 already unused, calling callback (ffffffffc0c98cf0) 00010000:00010000:1.0:1782727292.137965:0:5934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff921c4151c600/0x14a47870ee88caa8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727292.137972:0:5934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff921c4151c600/0x14a47870ee88caa8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727292.137985:0:5934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff921c4151c600/0x14a47870ee88caa8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727292.137994:0:5934:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782727292.138019:0:5934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c45e41500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c71e9f0f-6441-4b9b-bc96-153ab9250801+12:3444:x1869324939704576:12345-0@lo:103: Request processed in 204us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727292.138025:0:5934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782727292.138049:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c76442680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c71e9f0f-6441-4b9b-bc96-153ab9250801:3444:1869324939704960:0@lo:103: 00000100:00100000:1.0:1782727292.138056:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c6e380a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c71e9f0f-6441-4b9b-bc96-153ab9250801:3444:1869324939704576:0@lo:103: 00010000:00010000:1.0:1782727292.138077:0:5944:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff921c4151c600/0x14a47870ee88caa8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727292.138083:0:5944:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff921c4151c600/0x14a47870ee88caa8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727292.138090:0:5944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921c4151c600/0x14a47870ee88caa8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1782727292.138108:0:5944:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1782727292.140266:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fdb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+11:8017:x1869324939703680:12345-0@lo:253: Request processed in 19241us (19612us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727292.140281:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1782727292.140377:0:8017:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e45f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:8017:1869324939703680:0@lo:253: 10000000:01000000:3.0:1782727292.140391:0:8017:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1782727292.140395:0:8017:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1782727292.140397:0:8017:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1782727292.140398:0:8017:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782727292.140400:0:8017:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1782727292.140401:0:8017:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782727292.140402:0:8017:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782727292.140404:0:8017:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782727292.140405:0:8017:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1782727292.140407:0:8017:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782727292.140408:0:8017:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1782727292.140429:0:8017:0:(tgt_mount.c:101:server_register_mount()) register mount ffff921c7d8c0800 from lustre-OST0001 10000000:01000000:3.0:1782727292.140458:0:8017:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1782727292.140461:0:8017:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1782727292.140468:0:8017:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff921c519f0000 local copy 10000000:01000000:3.0:1782727292.140472:0:8017:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1782727292.140504:0:8017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff921c4151c800/0x14a47870ee88caaf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727292.140512:0:8017:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.160@tcp lock: ffff921c4151c800/0x14a47870ee88caaf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727292.140534:0:8017:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff921c4151c800/0x14a47870ee88caaf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727292.140551:0:8017:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e45f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:8017:1869324939705088:0@lo:101: 00000100:00100000:3.0:1782727292.140584:0:8017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727292.140621:0:8017:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c6e342180 going to sleep for 11 seconds 00000100:00100000:2.0:1782727292.140664:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939705088 00000100:00100000:2.0:1782727292.140670:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939705088 00000100:00100000:2.0:1782727292.140718:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1782727292.140725:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fdb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+11:8017:x1869324939705088:12345-0@lo:101: 00010000:00010000:2.0:1782727292.140737:0:5942:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727292.140751:0:5942:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921c429d5a00/0x14a47870ee88cab6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x14a47870ee88caaf expref: -99 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727292.140774:0:5942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921c429d5a00/0x14a47870ee88cab6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x14a47870ee88caaf expref: 12 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727292.140784:0:5942:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921c429d5a00/0x14a47870ee88cab6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x14a47870ee88caaf expref: 12 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727292.140791:0:5942:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c429d5a00, rc 0) 00000100:00100000:2.0:1782727292.140934:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fdb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+12:8017:x1869324939705088:12345-0@lo:101: Request processed in 209us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727292.140941:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00010000:0.0:1782727292.141106:0:5938:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff921c7a3e0a00/0x14a47870ee88ca46 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x14a47870ee88ca4d expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727292.141115:0:5938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff921c7a3e0a00/0x14a47870ee88ca46 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x14a47870ee88ca4d expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727292.141129:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727292.141131:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727292.141133:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727292.141139:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727292.141148:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727292.141305:0:8017:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e45f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:8017:1869324939705088:0@lo:101: 00010000:00010000:3.0:1782727292.141318:0:8017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff921c4151c800/0x14a47870ee88caaf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x14a47870ee88cab6 expref: -99 pid: 8017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727292.141326:0:8017:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff921c4151c800/0x14a47870ee88caaf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x14a47870ee88cab6 expref: -99 pid: 8017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727292.141412:0:8017:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e45f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:8017:1869324939705216:0@lo:501: 00000100:00100000:3.0:1782727292.141439:0:8017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727292.141493:0:8017:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c6e342180 going to sleep for 11 seconds 00000100:00100000:2.0:1782727292.141524:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939705216 00000100:00100000:2.0:1782727292.141529:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939705216 00000100:00100000:2.0:1782727292.141584:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1782727292.141591:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fdb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+12:8017:x1869324939705216:12345-0@lo:501: 00000100:00100000:2.0:1782727292.141648:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fdb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+12:8017:x1869324939705216:12345-0@lo:501: Request processed in 57us (207us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782727292.141654:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1782727292.141706:0:8017:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e45f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:8017:1869324939705216:0@lo:501: 10000000:01000000:3.0:1782727292.141716:0:8017:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.160@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1782727292.141731:0:8017:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.160@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1782727292.141736:0:8017:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff921c4151c800/0x14a47870ee88caaf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x14a47870ee88cab6 expref: -99 pid: 8017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727292.141743:0:8017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff921c4151c800/0x14a47870ee88caaf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x14a47870ee88cab6 expref: -99 pid: 8017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727292.141750:0:8017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.160@tcp lock: ffff921c4151c800/0x14a47870ee88caaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x14a47870ee88cab6 expref: -99 pid: 8017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727292.141780:0:8017:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1782727292.141804:0:8017:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff921c7d8c0800 10000000:01000000:3.0:1782727292.141809:0:8017:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1782727292.141814:0:8017:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1782727292.141817:0:8017:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1782727292.141821:0:8017:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1782727292.141824:0:8017:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1782727292.141839:0:8017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff921c4151c400/0x14a47870ee88cabd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727292.141846:0:8017:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff921c4151c400/0x14a47870ee88cabd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727292.141854:0:8017:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff921c4151c400/0x14a47870ee88cabd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727292.141866:0:8017:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e45f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:8017:1869324939705344:0@lo:101: 00000100:00100000:3.0:1782727292.141911:0:8017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782727292.141967:0:5937:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782727292.141973:0:5937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff921c4151c800/0x14a47870ee88caaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x14a47870ee88cab6 expref: -99 pid: 8017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727292.141980:0:5937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c4151c800 already unused, calling callback (ffffffffc12b0c20) 10000000:00010000:0.0:1782727292.141983:0:5937:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff921c4151c800/0x14a47870ee88caaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x14a47870ee88cab6 expref: -99 pid: 8017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727292.141991:0:5937:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff921c4151c800/0x14a47870ee88caaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x14a47870ee88cab6 expref: -99 pid: 8017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782727292.141998:0:5937:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff921c4151c800/0x14a47870ee88caaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x14a47870ee88cab6 expref: -99 pid: 8017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782727292.142003:0:5937:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782727292.142022:0:5937:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff921c4151c800/0x14a47870ee88caaf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x14a47870ee88cab6 expref: -99 pid: 8017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727292.142028:0:5937:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782727292.142041:0:5937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff921c4151c800/0x14a47870ee88caaf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x14a47870ee88cab6 expref: -99 pid: 8017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727292.142048:0:5937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff921c4151c800/0x14a47870ee88caaf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x14a47870ee88cab6 expref: -99 pid: 8017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727292.142060:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727292.142062:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727292.142064:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727292.142331:0:8017:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c6e342d80 going to sleep for 11 seconds 00000100:00100000:1.0:1782727292.142392:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939705344 00000100:00100000:1.0:1782727292.142397:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939705344 00000100:00100000:1.0:1782727292.142423:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1782727292.142430:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fdb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+12:8017:x1869324939705344:12345-0@lo:101: 00010000:00010000:1.0:1782727292.142438:0:5943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727292.142449:0:5943:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921c43a23400/0x14a47870ee88cac4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x14a47870ee88cabd expref: -99 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727292.142467:0:5943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921c43a23400/0x14a47870ee88cac4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x14a47870ee88cabd expref: 13 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727292.142476:0:5943:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921c43a23400/0x14a47870ee88cac4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x14a47870ee88cabd expref: 13 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727292.142484:0:5943:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c43a23400, rc 0) 00000100:00100000:1.0:1782727292.142525:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fdb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+13:8017:x1869324939705344:12345-0@lo:101: Request processed in 95us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727292.142531:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1782727292.142557:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782727292.142568:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c76441180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c71e9f0f-6441-4b9b-bc96-153ab9250801:3444:1869324939705472:0@lo:103: 00000100:00100000:1.0:1782727292.142592:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727292.142616:0:5934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939705472 00000100:00100000:1.0:1782727292.142619:0:5934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939705472 00000100:00100000:1.0:1782727292.142647:0:5934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782727292.142654:0:5934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6e380a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c71e9f0f-6441-4b9b-bc96-153ab9250801+13:3444:x1869324939705472:12345-0@lo:103: 00010000:00010000:1.0:1782727292.142663:0:5934:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782727292.142753:0:5934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921c429d5a00/0x14a47870ee88cab6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x14a47870ee88caaf expref: 13 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727292.142764:0:5934:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782727292.142789:0:5934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6e380a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c71e9f0f-6441-4b9b-bc96-153ab9250801+12:3444:x1869324939705472:12345-0@lo:103: Request processed in 135us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727292.142795:0:5934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782727292.142825:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c76441180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c71e9f0f-6441-4b9b-bc96-153ab9250801:3444:1869324939705472:0@lo:103: 00000100:00100000:3.0:1782727292.142929:0:8017:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e45f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:8017:1869324939705344:0@lo:101: 00010000:00010000:3.0:1782727292.142942:0:8017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff921c4151c400/0x14a47870ee88cabd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88cac4 expref: -99 pid: 8017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727292.142949:0:8017:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff921c4151c400/0x14a47870ee88cabd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x14a47870ee88cac4 expref: -99 pid: 8017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727292.143016:0:8017:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e45f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:8017:1869324939705600:0@lo:501: 00000100:00100000:3.0:1782727292.143048:0:8017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727292.143063:0:8017:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c6e342d80 going to sleep for 11 seconds 00000100:00100000:1.0:1782727292.143301:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939705600 00000100:00100000:1.0:1782727292.143306:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939705600 00000100:00100000:1.0:1782727292.143327:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1782727292.143332:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fdb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+12:8017:x1869324939705600:12345-0@lo:501: 00000100:00100000:1.0:1782727292.143427:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fdb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+12:8017:x1869324939705600:12345-0@lo:501: Request processed in 94us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727292.143433:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1782727292.143601:0:8017:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e45f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:8017:1869324939705600:0@lo:501: 00000100:00100000:3.0:1782727292.143628:0:8017:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e45f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:8017:1869324939705728:0@lo:503: 00000100:00100000:3.0:1782727292.143671:0:8017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727292.143709:0:8017:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c6e342d80 going to sleep for 11 seconds 00000100:00100000:1.0:1782727292.143809:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939705728 00000100:00100000:1.0:1782727292.143813:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939705728 00000100:00100000:1.0:1782727292.143830:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1782727292.143835:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fdb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+12:8017:x1869324939705728:12345-0@lo:503: 00000100:00100000:1.0:1782727292.143940:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fdb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+12:8017:x1869324939705728:12345-0@lo:503: Request processed in 104us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727292.143947:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1782727292.144187:0:8017:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e45f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:8017:1869324939705728:0@lo:503: 00000040:00080000:3.0:1782727292.144427:0:8017:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1782727292.144492:0:8017:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e45f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:8017:1869324939705856:0@lo:502: 00000100:00100000:3.0:1782727292.144529:0:8017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727292.144559:0:8017:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c6e342d80 going to sleep for 11 seconds 00000100:00100000:1.0:1782727292.144605:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939705856 00000100:00100000:1.0:1782727292.144609:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939705856 00000100:00100000:1.0:1782727292.144640:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1782727292.144648:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fdb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+12:8017:x1869324939705856:12345-0@lo:502: 00000100:00100000:1.0:1782727292.144837:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fdb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+12:8017:x1869324939705856:12345-0@lo:502: Request processed in 189us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727292.144851:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1782727292.145114:0:8017:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e45f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:8017:1869324939705856:0@lo:502: 00000040:00080000:3.0:1782727292.145322:0:8017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1782727292.145351:0:8017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1782727292.145365:0:8017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1782727292.145378:0:8017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1782727292.145390:0:8017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1782727292.145401:0:8017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1782727292.145426:0:8017:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e45f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:8017:1869324939705984:0@lo:502: 00000100:00100000:3.0:1782727292.145460:0:8017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727292.145489:0:8017:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c6e342d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782727292.145536:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939705984 00000100:00100000:2.0:1782727292.145546:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939705984 00000100:00100000:2.0:1782727292.145580:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1782727292.145588:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fdb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+12:8017:x1869324939705984:12345-0@lo:502: 00000100:00100000:2.0:1782727292.145667:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fdb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+12:8017:x1869324939705984:12345-0@lo:502: Request processed in 80us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727292.145682:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1782727292.145811:0:8017:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e45f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:8017:1869324939705984:0@lo:502: 00000040:00080000:3.0:1782727292.145845:0:8017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1782727292.145853:0:8017:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1782727292.146306:0:8028:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1782727292.146315:0:8028:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1782727292.146328:0:8028:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782727292.146330:0:8028:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1782727292.146337:0:8028:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1782727292.146351:0:8028:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff921c76568000) 00000020:00000080:3.0:1782727292.146370:0:8028:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:3.0:1782727292.146374:0:8028:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1782727292.146446:0:8028:0:(tgt_mount.c:153:server_get_mount()) get mount ffff921c7d8c0800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1782727292.146454:0:8028:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:3.0:1782727292.146468:0:8028:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x14a47870ee88cad2 00010000:00010000:2.0:1782727292.151804:0:8028:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:2.0:1782727292.152303:0:8028:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1782727292.161617:0:8028:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1782727292.162398:0:8028:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1782727292.168412:0:8028:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:1.0:1782727292.168602:0:8028:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:1.0:1782727292.176380:0:8028:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:1.0:1782727292.178934:0:8028:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1782727292.178947:0:8028:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782727292.178953:0:8028:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782727292.178955:0:8028:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1782727292.178959:0:8028:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782727292.178964:0:8028:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782727292.178965:0:8028:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1782727292.178967:0:8028:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1782727292.178969:0:8028:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1782727292.178993:0:8028:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782727292.178996:0:8028:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782727292.178997:0:8028:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:1.0:1782727292.179000:0:8028:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1782727292.182830:0:8017:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1782727292.182925:0:8017:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1782727292.182954:0:8017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff921c4151c400/0x14a47870ee88cabd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88cac4 expref: -99 pid: 8017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727292.182968:0:8017:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff921c4151c400/0x14a47870ee88cabd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88cac4 expref: -99 pid: 8017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727292.182977:0:8017:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff921c7d8c0800 from 1 10000000:01000000:3.0:1782727292.182980:0:8017:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782727292.183022:0:8017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff921c4151c200/0x14a47870ee88cad9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727292.183031:0:8017:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff921c4151c200/0x14a47870ee88cad9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727292.183041:0:8017:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff921c4151c200/0x14a47870ee88cad9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727292.183068:0:8017:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e45f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:8017:1869324939706112:0@lo:101: 00000100:00100000:3.0:1782727292.183140:0:8017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727292.183179:0:8017:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c6e342240 going to sleep for 11 seconds 00000100:00100000:2.0:1782727292.183668:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939706112 00000100:00100000:2.0:1782727292.183689:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939706112 00000100:00100000:2.0:1782727292.183750:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1782727292.183760:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fdb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+12:8017:x1869324939706112:12345-0@lo:101: 00010000:00010000:2.0:1782727292.183773:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727292.183785:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921c429d4800/0x14a47870ee88cae0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x14a47870ee88cad9 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727292.183812:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921c429d4800/0x14a47870ee88cae0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x14a47870ee88cad9 expref: 13 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727292.183823:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921c429d4800/0x14a47870ee88cae0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x14a47870ee88cad9 expref: 13 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727292.183832:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c429d4800, rc 0) 00000100:00100000:2.0:1782727292.183879:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fdb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+13:8017:x1869324939706112:12345-0@lo:101: Request processed in 121us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727292.184023:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1782727292.184077:0:8017:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e45f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:8017:1869324939706112:0@lo:101: 00010000:00010000:2.0:1782727292.184092:0:8017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff921c4151c200/0x14a47870ee88cad9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88cae0 expref: -99 pid: 8017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727292.184107:0:8017:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff921c4151c200/0x14a47870ee88cad9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x14a47870ee88cae0 expref: -99 pid: 8017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727292.184203:0:8017:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e40a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:8017:1869324939706240:0@lo:501: 00000100:00100000:2.0:1782727292.184232:0:8017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727292.184259:0:8017:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c7d954480 going to sleep for 11 seconds 00000100:00100000:3.0:1782727292.184565:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939706240 00000100:00100000:3.0:1782727292.184570:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939706240 00000100:00100000:3.0:1782727292.184605:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1782727292.184612:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fdb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+13:8017:x1869324939706240:12345-0@lo:501: 00000100:00100000:3.0:1782727292.184714:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fdb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+13:8017:x1869324939706240:12345-0@lo:501: Request processed in 101us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727292.184721:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1782727292.186899:0:8017:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e40a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:8017:1869324939706240:0@lo:501: 00000100:00100000:2.0:1782727292.186961:0:8017:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e40a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:8017:1869324939706368:0@lo:503: 00000100:00100000:2.0:1782727292.187039:0:8017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727292.187069:0:8017:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c7d954480 going to sleep for 11 seconds 00000100:00100000:1.0:1782727292.187413:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939706368 00000100:00100000:1.0:1782727292.187420:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939706368 00000100:00100000:1.0:1782727292.187472:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1782727292.187482:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fdb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+13:8017:x1869324939706368:12345-0@lo:503: 00000100:00100000:1.0:1782727292.187605:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fdb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+13:8017:x1869324939706368:12345-0@lo:503: Request processed in 124us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727292.187613:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1782727292.187860:0:8017:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e40a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:8017:1869324939706368:0@lo:503: 00000040:00080000:2.0:1782727292.188170:0:8017:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1782727292.189575:0:8017:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e40a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:8017:1869324939706496:0@lo:502: 00000100:00100000:2.0:1782727292.189660:0:8017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727292.190630:0:8017:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c7d954480 going to sleep for 11 seconds 00000100:00100000:3.0:1782727292.192011:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939706496 00000100:00100000:3.0:1782727292.192022:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939706496 00000100:00100000:3.0:1782727292.192078:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1782727292.192089:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fdb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+13:8017:x1869324939706496:12345-0@lo:502: 00000100:00100000:3.0:1782727292.194060:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fdb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+13:8017:x1869324939706496:12345-0@lo:502: Request processed in 1965us (4391us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727292.194072:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1782727292.194299:0:8017:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e40a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:8017:1869324939706496:0@lo:502: 00000040:00080000:1.0:1782727292.194538:0:8017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1782727292.194569:0:8017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1782727292.194612:0:8017:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c6e381180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:8017:1869324939706624:0@lo:502: 00000100:00100000:1.0:1782727292.194668:0:8017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727292.194717:0:8017:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c5152f480 going to sleep for 11 seconds 00000100:00100000:2.0:1782727292.194846:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939706624 00000100:00100000:2.0:1782727292.194853:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939706624 00000100:00100000:2.0:1782727292.194917:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1782727292.194927:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fdb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+13:8017:x1869324939706624:12345-0@lo:502: 00000100:00100000:2.0:1782727292.195038:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fdb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+13:8017:x1869324939706624:12345-0@lo:502: Request processed in 113us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727292.195045:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1782727292.195429:0:8017:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c6e381180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:8017:1869324939706624:0@lo:502: 00000040:00080000:1.0:1782727292.195477:0:8017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1782727292.195486:0:8017:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1782727292.196165:0:8032:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782727292.196175:0:8032:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782727292.196178:0:8032:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1782727292.196190:0:8032:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff921c7d8c0800 00000020:00000080:0.0:1782727292.196193:0:8032:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1782727292.196208:0:8032:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782727292.196211:0:8032:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782727292.196212:0:8032:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1782727292.196215:0:8032:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1782727292.196389:0:8017:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1782727292.196418:0:8017:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782727292.196440:0:8017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff921c4151c200/0x14a47870ee88cad9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88cae0 expref: -99 pid: 8017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727292.196451:0:8017:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff921c4151c200/0x14a47870ee88cad9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88cae0 expref: -99 pid: 8017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782727292.196496:0:8017:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1782727292.196499:0:8017:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff921c7d8c0800 10000000:01000000:1.0:1782727292.196502:0:8017:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff921c7d8c0800 10000000:01000000:1.0:1782727292.196506:0:8017:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1782727292.196512:0:8017:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff921c7d8c0800 from 1 10000000:01000000:1.0:1782727292.196515:0:8017:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1782727292.196546:0:8017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff921c43a22c00/0x14a47870ee88cae7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727292.196554:0:8017:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff921c43a22c00/0x14a47870ee88cae7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727292.196563:0:8017:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff921c43a22c00/0x14a47870ee88cae7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727292.196579:0:8017:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c6e381180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:8017:1869324939706752:0@lo:101: 00000100:00100000:1.0:1782727292.196631:0:8017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727292.196730:0:8017:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c5152f900 going to sleep for 11 seconds 00000100:00100000:3.0:1782727292.197338:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939706752 00000100:00100000:3.0:1782727292.197346:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939706752 00000100:00100000:3.0:1782727292.197429:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1782727292.197440:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fdb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+13:8017:x1869324939706752:12345-0@lo:101: 00010000:00010000:3.0:1782727292.197455:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727292.197469:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921c4151d000/0x14a47870ee88caee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x14a47870ee88cae7 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727292.197493:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921c4151d000/0x14a47870ee88caee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x14a47870ee88cae7 expref: 14 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727292.197504:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921c4151d000/0x14a47870ee88caee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x14a47870ee88cae7 expref: 14 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727292.197513:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c4151d000, rc 0) 00000100:00100000:3.0:1782727292.197578:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fdb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+14:8017:x1869324939706752:12345-0@lo:101: Request processed in 140us (945us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727292.197585:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1782727292.197657:0:8017:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c6e381180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:8017:1869324939706752:0@lo:101: 00010000:00010000:2.0:1782727292.197680:0:8017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff921c43a22c00/0x14a47870ee88cae7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88caee expref: -99 pid: 8017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727292.197695:0:8017:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff921c43a22c00/0x14a47870ee88cae7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x14a47870ee88caee expref: -99 pid: 8017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727292.197784:0:8017:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e42300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:8017:1869324939706880:0@lo:501: 00000100:00100000:2.0:1782727292.197811:0:8017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727292.198134:0:8017:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c7d954780 going to sleep for 11 seconds 00000100:00100000:1.0:1782727292.198205:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939706880 00000100:00100000:1.0:1782727292.198210:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939706880 00000100:00100000:1.0:1782727292.198233:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1782727292.198251:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fd13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+14:8017:x1869324939706880:12345-0@lo:501: 00000100:00100000:1.0:1782727292.198387:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fd13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+14:8017:x1869324939706880:12345-0@lo:501: Request processed in 147us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727292.198395:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1782727292.198497:0:8017:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e42300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:8017:1869324939706880:0@lo:501: 00000100:00100000:2.0:1782727292.198524:0:8017:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e42300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:8017:1869324939707008:0@lo:503: 00000100:00100000:2.0:1782727292.198567:0:8017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727292.198617:0:8017:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c7d954780 going to sleep for 11 seconds 00000100:00100000:0.0:1782727292.198643:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939707008 00000100:00100000:0.0:1782727292.198648:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939707008 00000100:00100000:1.0:1782727292.198764:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1782727292.198772:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fd13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+14:8017:x1869324939707008:12345-0@lo:503: 00000100:00100000:1.0:1782727292.198852:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fd13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+14:8017:x1869324939707008:12345-0@lo:503: Request processed in 81us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727292.198860:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1782727292.199286:0:8017:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e42300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:8017:1869324939707008:0@lo:503: 00000040:00080000:2.0:1782727292.199499:0:8017:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1782727292.199560:0:8017:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e42300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:8017:1869324939707136:0@lo:502: 00000100:00100000:2.0:1782727292.199597:0:8017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727292.199659:0:8017:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c7d954780 going to sleep for 11 seconds 00000100:00100000:1.0:1782727292.199770:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939707136 00000100:00100000:1.0:1782727292.199776:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939707136 00000100:00100000:1.0:1782727292.199808:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1782727292.199815:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fd12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+14:8017:x1869324939707136:12345-0@lo:502: 00000100:00100000:1.0:1782727292.200441:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fd12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+14:8017:x1869324939707136:12345-0@lo:502: Request processed in 623us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727292.200449:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1782727292.201225:0:8017:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e42300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:8017:1869324939707136:0@lo:502: 00000040:00080000:2.0:1782727292.201751:0:8017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1782727292.201785:0:8017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1782727292.201818:0:8017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1782727292.201834:0:8017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1782727292.201848:0:8017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1782727292.201862:0:8017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1782727292.201875:0:8017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1782727292.202277:0:8017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1782727292.202295:0:8017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1782727292.202307:0:8017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1782727292.202330:0:8017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1782727292.202343:0:8017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1782727292.202357:0:8017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1782727292.202369:0:8017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1782727292.202381:0:8017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1782727292.202394:0:8017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1782727292.202408:0:8017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1782727292.202421:0:8017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1782727292.202447:0:8017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1782727292.202462:0:8017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1782727292.202476:0:8017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1782727292.202487:0:8017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1782727292.202499:0:8017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1782727292.202512:0:8017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1782727292.202524:0:8017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1782727292.202536:0:8017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1782727292.202548:0:8017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1782727292.202559:0:8017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1782727292.202571:0:8017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1782727292.208261:0:8017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:3.0:1782727292.208298:0:8017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:3.0:1782727292.208312:0:8017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:3.0:1782727292.208324:0:8017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:3.0:1782727292.208337:0:8017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:3.0:1782727292.208349:0:8017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:3.0:1782727292.208362:0:8017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:3.0:1782727292.208374:0:8017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:3.0:1782727292.208424:0:8017:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e45500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:8017:1869324939707264:0@lo:502: 00000100:00100000:3.0:1782727292.208505:0:8017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727292.208589:0:8017:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c49b653c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782727292.208634:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939707264 00000100:00100000:2.0:1782727292.208641:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939707264 00000100:00100000:2.0:1782727292.208799:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1782727292.208818:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fd10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+14:8017:x1869324939707264:12345-0@lo:502: 00000100:00100000:2.0:1782727292.208971:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fd10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+14:8017:x1869324939707264:12345-0@lo:502: Request processed in 162us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727292.208979:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1782727292.209067:0:8017:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e45500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:8017:1869324939707264:0@lo:502: 00000040:00080000:3.0:1782727292.209114:0:8017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1782727292.209125:0:8017:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1782727292.209689:0:8033:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1782727292.209703:0:8033:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff921c7656cd70) 00000020:00000080:3.0:1782727292.209723:0:8033:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:3.0:1782727292.209937:0:8033:0:(tgt_mount.c:153:server_get_mount()) get mount ffff921c7d8c0800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1782727292.209942:0:8033:0:(tgt_mount.c:187:server_put_mount()) put mount ffff921c7d8c0800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1782727292.209944:0:8033:0:(obd_mount.c:701:lustre_put_lsi()) put ffff921c7d8c0800 3 00010000:00080000:3.0:1782727292.209979:0:8033:0:(ldlm_lib.c:102:import_set_conn()) imp ffff921c7db06000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.160@tcp at head 00010000:00010000:3.0:1782727292.212148:0:8033:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:3.0:1782727292.212266:0:8033:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1782727292.212309:0:8033:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1782727292.212321:0:8033:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x14a47870ee88cafc 00000100:00080000:3.0:1782727292.212332:0:8033:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1782727292.212344:0:8033:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff921c7db06000 using connection 192.168.202.160@tcp/0@lo 00000100:00100000:3.0:1782727292.212378:0:8033:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff921c45e45500 x1869324939707392/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782727292.212422:0:3441:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3441:1869324939707392:0@lo:38: 00000100:00100000:3.0:1782727292.212485:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1782727292.212537:0:8033:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1782727292.212938:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939707392 00000100:00100000:1.0:1782727292.212946:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939707392 00000100:00100000:1.0:1782727292.212976:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782727292.212983:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c45e45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3441:x1869324939707392:12345-0@lo:38: 00010000:00080000:1.0:1782727292.213007:0:5950:0:(ldlm_lib.c:1434:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 186 last 0 00000020:00000080:1.0:1782727292.213037:0:5950:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x14a47870ee88cb03 00000004:00100000:1.0:1782727292.213056:0:5950:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1782727292.213085:0:5950:0:(import.c:65:import_set_state_nolock()) ffff921c7d8c2800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782727292.213141:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c45e45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3441:x1869324939707392:12345-0@lo:38: Request processed in 157us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727292.213148:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782727292.213171:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3442:1869324939707520:0@lo:400: 00000100:00100000:1.0:1782727292.213198:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727292.213216:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782727292.213222:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3442:1869324939707648:0@lo:400: 00000100:00100000:1.0:1782727292.213254:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727292.213279:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869324939707776:0@lo:400: 00000100:00100000:1.0:1782727292.213304:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727292.213332:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939707520 00000100:00100000:1.0:1782727292.213336:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939707520 00000100:00100000:1.0:1782727292.213357:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939707648 00000100:00100000:1.0:1782727292.213360:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939707648 00000100:00100000:1.0:1782727292.213383:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782727292.213388:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6e382680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1869324939707520:12345-0@lo:400: 00000100:00100000:1.0:1782727292.213422:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6e382680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1869324939707520:12345-0@lo:400: Request processed in 33us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727292.213427:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782727292.213438:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782727292.213444:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6e381880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1869324939707648:12345-0@lo:400: 00000100:00100000:1.0:1782727292.213467:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6e381880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1869324939707648:12345-0@lo:400: Request processed in 24us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727292.213473:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1782727292.213506:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff921c45e45180 x1869324939707648/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727308 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727292.213527:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3442:1869324939707648:0@lo:400: 00010000:00080000:1.0:1782727292.213539:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff921c45e46680 x1869324939707520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727308 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727292.213548:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3442:1869324939707520:0@lo:400: 00010000:00080000:1.0:1782727292.213583:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff921c45e45500 x1869324939707392/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782727302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727292.213591:0:3441:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1782727292.213597:0:3441:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1782727292.213605:0:3441:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1782727292.213610:0:3441:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1782727292.213613:0:3441:0:(import.c:65:import_set_state_nolock()) ffff921c7db06000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1782727292.213619:0:3441:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3441:1869324939707392:0@lo:38: 00000100:00100000:0.0:1782727292.216368:0:6949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939707776 00000100:00100000:0.0:1782727292.216382:0:6949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939707776 00000100:00100000:0.0:1782727292.216453:0:6949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782727292.216464:0:6949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6e383480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324939707776:12345-0@lo:400: 00000100:00100000:0.0:1782727292.216559:0:6949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6e383480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324939707776:12345-0@lo:400: Request processed in 97us (3253us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727292.216566:0:6949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1782727292.219517:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff921c45e44a80 x1869324939707776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727308 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727292.219537:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869324939707776:0@lo:400: 00000100:00080000:3.0:1782727292.220111:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782727292.220118:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1782727292.222668:0:8033:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:2.0:1782727292.222820:0:8034:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e42300 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:8034:1869324939707904:0@lo:901: 00000100:00100000:2.0:1782727292.222918:0:8034:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727292.222944:0:8034:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c7d954540 going to sleep for 11 seconds 00000100:00100000:1.0:1782727292.223070:0:5960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939707904 00000100:00100000:1.0:1782727292.223076:0:5960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939707904 00000100:00100000:1.0:1782727292.223117:0:5960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782727292.223135:0:5960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c45e43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8034:x1869324939707904:12345-0@lo:901: 00000100:00100000:1.0:1782727292.223210:0:5960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c45e43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8034:x1869324939707904:12345-0@lo:901: Request processed in 76us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727292.223216:0:5960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1782727292.223322:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1782727292.223347:0:8034:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff921c45e42300 x1869324939707904/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1782727308 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727292.223376:0:8034:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e42300 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:8034:1869324939707904:0@lo:901: 00000020:01000000:1.0:1782727292.223798:0:8017:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1782727292.223833:0:8017:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1782727292.223850:0:8017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff921c43a22c00/0x14a47870ee88cae7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88caee expref: -99 pid: 8017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727292.223861:0:8017:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff921c43a22c00/0x14a47870ee88cae7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88caee expref: -99 pid: 8017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1782727292.223940:0:8017:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1782727292.223942:0:8017:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1782727292.223943:0:8017:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782727292.223945:0:8017:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782727292.223946:0:8017:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782727292.223948:0:8017:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782727292.223949:0:8017:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1782727292.223951:0:8017:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1782727292.223952:0:8017:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1782727292.223953:0:8017:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782727292.223955:0:8017:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1782727292.223959:0:8017:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1782727292.223961:0:8017:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1782727292.223962:0:8017:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1782727292.223963:0:8017:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782727292.223964:0:8017:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782727292.223965:0:8017:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782727292.223966:0:8017:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782727292.223967:0:8017:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1782727292.223968:0:8017:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1782727292.223969:0:8017:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1782727292.223971:0:8017:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782727292.223972:0:8017:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1782727292.223989:0:8017:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1782727292.224000:0:8017:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c6e380700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:8017:1869324939708032:0@lo:253: 00000100:00100000:1.0:1782727292.224038:0:8017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727292.224064:0:8017:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c5152f480 going to sleep for 11 seconds 00000100:00100000:3.0:1782727292.224284:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939708032 00000100:00100000:3.0:1782727292.224290:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939708032 00000100:00100000:3.0:1782727292.224327:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1782727292.224334:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fd11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+14:8017:x1869324939708032:12345-0@lo:253: 20000000:01000000:3.0:1782727292.224355:0:5943:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1782727292.224368:0:5943:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1782727292.235246:0:5943:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1782727292.235301:0:5943:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1782727292.235806:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fd11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+14:8017:x1869324939708032:12345-0@lo:253: Request processed in 11466us (11761us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727292.236029:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1782727292.236737:0:8017:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c6e380700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c71e9f0f-6441-4b9b-bc96-153ab9250801:8017:1869324939708032:0@lo:253: 10000000:01000000:1.0:1782727292.236754:0:8017:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1782727292.236757:0:8017:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1782727292.236759:0:8017:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1782727292.236760:0:8017:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782727292.236762:0:8017:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782727292.236763:0:8017:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782727292.236764:0:8017:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782727292.236779:0:8017:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1782727292.236781:0:8017:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1782727292.236783:0:8017:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1782727292.236784:0:8017:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782727292.236786:0:8017:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1782727292.236800:0:8017:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1782727292.239226:0:5965:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1782727292.239235:0:5965:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1782727292.239270:0:5965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff921c7a3e0a00/0x14a47870ee88cb0a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727292.239286:0:5965:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff921c43a22e00/0x14a47870ee88ca5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x14a47870ee88ca54 expref: 13 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727292.239295:0:5965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff921c7a3e0a00/0x14a47870ee88cb0a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727292.239334:0:5965:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff921c43a22e00/0x14a47870ee88ca5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x14a47870ee88ca54 expref: 13 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727292.239348:0:5965:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff921c43a22e00/0x14a47870ee88ca5b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x14a47870ee88ca54 expref: 13 pid: 5944 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727292.239379:0:5965:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c76443b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5965:1869324939708160:0@lo:104: 00000100:00100000:0.0:1782727292.239438:0:5965:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727292.239553:0:5965:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c7d924b40 going to sleep for 11 seconds 00000100:00100000:3.0:1782727292.245705:0:5933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939708160 00000100:00100000:3.0:1782727292.245722:0:5933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939708160 00000100:00100000:3.0:1782727292.245798:0:5933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1782727292.246202:0:5933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c76441180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c71e9f0f-6441-4b9b-bc96-153ab9250801+3:5965:x1869324939708160:12345-0@lo:104: 00010000:00010000:3.0:1782727292.246246:0:5933:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.160@tcp lock: ffff921c429d4400/0x14a47870ee88ca54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x14a47870ee88ca5b expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727292.246388:0:5933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782727292.246395:0:5933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c76441180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c71e9f0f-6441-4b9b-bc96-153ab9250801+3:5965:x1869324939708160:12345-0@lo:104: Request processed in 587us (6956us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727292.246403:0:5933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1782727292.246424:0:5938:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782727292.246429:0:5938:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff921c429d4400/0x14a47870ee88ca54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x14a47870ee88ca5b expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727292.246438:0:5938:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c429d4400 already unused, calling callback (ffffffffc12b0c20) 10000000:00010000:3.0:1782727292.246443:0:5938:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff921c429d4400/0x14a47870ee88ca54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x14a47870ee88ca5b expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727292.246452:0:5938:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff921c429d4400/0x14a47870ee88ca54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x14a47870ee88ca5b expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782727292.246459:0:5938:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff921c429d4400/0x14a47870ee88ca54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x14a47870ee88ca5b expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727292.246464:0:5938:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1782727292.246497:0:5938:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff921c429d4400/0x14a47870ee88ca54 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x14a47870ee88ca5b expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727292.246503:0:5938:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782727292.246521:0:5938:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff921c429d4400/0x14a47870ee88ca54 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x14a47870ee88ca5b expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727292.246528:0:5938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff921c429d4400/0x14a47870ee88ca54 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x14a47870ee88ca5b expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727292.246552:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727292.246554:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727292.246556:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727292.246570:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c71e9f0f-6441-4b9b-bc96-153ab9250801:3445:1869324939708288:0@lo:103: 00000100:00100000:3.0:1782727292.246611:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727292.246712:0:5935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939708288 00000100:00100000:2.0:1782727292.246718:0:5935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939708288 00010000:00010000:2.0:1782727292.246741:0:5935:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff921c43a22e00/0x14a47870ee88ca5b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x14a47870ee88ca54 expref: 14 pid: 5944 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727292.246776:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1782727292.246783:0:5935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5302c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c71e9f0f-6441-4b9b-bc96-153ab9250801+14:3445:x1869324939708288:12345-0@lo:103: 00010000:00010000:2.0:1782727292.246794:0:5935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782727292.246799:0:5935:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff921c43a22e00/0x14a47870ee88ca5b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x14a47870ee88ca54 expref: 14 pid: 5944 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727292.246822:0:5935:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff921c43a22e00/0x14a47870ee88ca5b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x14a47870ee88ca54 expref: 14 pid: 5944 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727292.246841:0:5935:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff921c7a3e0a00/0x14a47870ee88cb0a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727292.246850:0:5935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921c7a3e0a00/0x14a47870ee88cb0a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1782727292.246866:0:5935:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007631597s 00010000:00010000:2.0:1782727292.246870:0:5935:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff921c7a3e0a00/0x14a47870ee88cb0a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727292.246878:0:5935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff921c7a3e0a00/0x14a47870ee88cb0a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727292.246920:0:5935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff921c7a3e0a00/0x14a47870ee88cb0a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727292.246935:0:5935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff921c7a3e0a00/0x14a47870ee88cb0a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727292.246941:0:5935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c7a3e0a00 already unused, calling callback (ffffffffc0c98cf0) 00010000:00010000:2.0:1782727292.246945:0:5935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff921c7a3e0a00/0x14a47870ee88cb0a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727292.246952:0:5935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff921c7a3e0a00/0x14a47870ee88cb0a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727292.246962:0:5935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff921c7a3e0a00/0x14a47870ee88cb0a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727292.246971:0:5935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782727292.247003:0:5935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5302c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c71e9f0f-6441-4b9b-bc96-153ab9250801+14:3445:x1869324939708288:12345-0@lo:103: Request processed in 220us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727292.247010:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1782727292.247062:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c71e9f0f-6441-4b9b-bc96-153ab9250801:3445:1869324939708288:0@lo:103: 00080000:10000000:3.0:1782727292.248318:0:8017:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1782727292.248481:0:8017:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1782727292.248685:0:8017:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1782727292.250218:0:8017:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1782727292.250527:0:8017:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1782727292.251550:0:8017:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00010000:00010000:0.0:1782727292.253855:0:5965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921c43a22e00/0x14a47870ee88ca5b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x14a47870ee88ca54 expref: 13 pid: 5944 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727292.253878:0:5965:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c76443b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5965:1869324939708160:0@lo:104: 00010000:00010000:0.0:1782727292.253930:0:5965:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff921c7a3e0a00/0x14a47870ee88cb0a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727292.253941:0:5965:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff921c7a3e0a00/0x14a47870ee88cb0a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727292.253946:0:5965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff921c7a3e0a00/0x14a47870ee88cb0a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727292.253952:0:5965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921c7a3e0a00/0x14a47870ee88cb0a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:0.0:1782727292.257208:0:8017:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1782727292.268532:0:8017:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1782727292.268542:0:8017:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1782727292.268577:0:8017:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1782727292.268626:0:8017:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.160@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1782727292.268650:0:8017:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1782727292.268753:0:8017:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1782727292.269756:0:8017:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1782727292.270207:0:8017:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1782727292.351642:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727293.371927:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1782727293.465608:0:8087:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1782727293.466056:0:8087:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1782727294.394440:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727295.418046:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727295.673104:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782727295.673128:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869324939708416:0@lo:13: 00000100:00100000:3.0:1782727295.673194:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727295.673434:0:6952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939708416 00000100:00100000:2.0:1782727295.673441:0:6952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939708416 00000100:00100000:2.0:1782727295.673498:0:6952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782727295.673507:0:6952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c45e47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1869324939708416:12345-0@lo:13: 00002000:00000024:2.0:1782727295.673534:0:6952:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1782727295.673576:0:6952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c45e47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1869324939708416:12345-0@lo:13: Request processed in 69us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727295.673582:0:6952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1782727295.673620:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c45e41880 x1869324939708416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727311 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727295.673661:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869324939708416:0@lo:13: 00000100:00080000:3.0:1782727295.674022:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1782727296.441065:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727297.467459:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727297.721787:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3445:1869324939708800:0@lo:400: 00000100:00100000:2.0:1782727297.721860:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727297.721931:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782727297.721937:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3445:1869324939708672:0@lo:400: 00000100:00100000:2.0:1782727297.721960:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727297.722044:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c71e9f0f-6441-4b9b-bc96-153ab9250801:3443:1869324939708544:0@lo:400: 00000100:00100000:3.0:1782727297.722081:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727297.722100:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3443:1869324939709056:0@lo:400: 00000100:00100000:3.0:1782727297.722119:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727297.722136:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782727297.722141:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869324939708928:0@lo:400: 00000100:00100000:3.0:1782727297.722162:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727297.722242:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939708800 00000100:00100000:3.0:1782727297.722249:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939708800 00000100:00100000:3.0:1782727297.722292:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939708672 00000100:00100000:3.0:1782727297.722295:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939708672 00000100:00100000:3.0:1782727297.722306:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939709056 00000100:00100000:3.0:1782727297.722308:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939709056 00000100:00100000:3.0:1782727297.722324:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1782727297.722332:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c45e40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3445:x1869324939708800:12345-0@lo:400: 00000100:00100000:3.0:1782727297.722384:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c45e40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3445:x1869324939708800:12345-0@lo:400: Request processed in 52us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727297.722390:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1782727297.722405:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1782727297.722411:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c45e40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1869324939708672:12345-0@lo:400: 00000100:00100000:3.0:1782727297.722436:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c45e40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1869324939708672:12345-0@lo:400: Request processed in 25us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727297.722441:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1782727297.722451:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1782727297.722458:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c45e47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1869324939709056:12345-0@lo:400: 00000100:00100000:3.0:1782727297.722487:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c45e47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1869324939709056:12345-0@lo:400: Request processed in 30us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727297.722493:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1782727297.722509:0:6951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939708928 00000100:00100000:3.0:1782727297.722512:0:6951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939708928 00000100:00100000:3.0:1782727297.722538:0:6951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782727297.722544:0:6951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c45e46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3443:x1869324939708928:12345-0@lo:400: 00000100:00100000:3.0:1782727297.722571:0:6951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c45e46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3443:x1869324939708928:12345-0@lo:400: Request processed in 28us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727297.722591:0:6951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1782727297.722614:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782727297.722618:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1782727297.722645:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c45e41180 x1869324939708928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727297.722658:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869324939708928:0@lo:400: 00010000:00080000:3.0:1782727297.722669:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c45e40000 x1869324939709056/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727297.722678:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3443:1869324939709056:0@lo:400: 00010000:00080000:3.0:1782727297.722705:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c45e41500 x1869324939708672/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727297.722711:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3445:1869324939708672:0@lo:400: 00010000:00080000:3.0:1782727297.722720:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c45e42300 x1869324939708800/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727297.722728:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3445:1869324939708800:0@lo:400: 00000100:00100000:2.0:1782727297.723975:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939708544 00000100:00100000:2.0:1782727297.723985:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939708544 00000100:00100000:2.0:1782727297.724077:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1782727297.724085:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fd10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+13:3443:x1869324939708544:12345-0@lo:400: 00000100:00100000:2.0:1782727297.724149:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fd10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+13:3443:x1869324939708544:12345-0@lo:400: Request processed in 65us (2066us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727297.724156:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1782727297.724261:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c71e9f0f-6441-4b9b-bc96-153ab9250801:3443:1869324939708544:0@lo:400: 00010000:00010000:3.0:1782727298.490411:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782727299.174993:0:8377:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg260-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1782727299.514913:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1782727300.235221:0:8429:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1782727300.235400:0:8429:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1782727300.538402:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727300.793405:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869324939709184:0@lo:13: 00000100:00100000:2.0:1782727300.793473:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727300.793542:0:6952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939709184 00000100:00100000:2.0:1782727300.793550:0:6952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939709184 00000100:00100000:2.0:1782727300.793604:0:6952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782727300.793613:0:6952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c45e42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324939709184:12345-0@lo:13: 00002000:00000024:2.0:1782727300.793639:0:6952:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1782727300.793679:0:6952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c45e42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324939709184:12345-0@lo:13: Request processed in 67us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727300.793686:0:6952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1782727300.793706:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1782727300.793735:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c45e41880 x1869324939709184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727316 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727300.793758:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869324939709184:0@lo:13: 10000000:01000000:1.0:1782727300.793830:0:5946:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1782727300.793835:0:5946:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff921c45e6f800 from 30 10000000:01000000:1.0:1782727300.793838:0:5946:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1782727300.793865:0:5946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff921c43a22e00/0x14a47870ee88cb11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727300.793874:0:5946:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff921c43a22e00/0x14a47870ee88cb11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727300.793907:0:5946:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff921c43a22e00/0x14a47870ee88cb11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727300.793923:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c6e380700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939709312:0@lo:101: 00000100:00100000:1.0:1782727300.793959:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727300.793984:0:5946:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c58a36540 going to sleep for 11 seconds 00000100:00100000:2.0:1782727300.794969:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939709312 00000100:00100000:2.0:1782727300.794976:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939709312 00000100:00100000:2.0:1782727300.795019:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1782727300.795027:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fd12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+13:5946:x1869324939709312:12345-0@lo:101: 00010000:00010000:2.0:1782727300.795038:0:5943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727300.795050:0:5943:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921c429d5e00/0x14a47870ee88cb18 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x14a47870ee88cb11 expref: -99 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727300.795071:0:5943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921c429d5e00/0x14a47870ee88cb18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x14a47870ee88cb11 expref: 14 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727300.795081:0:5943:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921c429d5e00/0x14a47870ee88cb18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x14a47870ee88cb11 expref: 14 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727300.795089:0:5943:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c429d5e00, rc 0) 00000100:00100000:2.0:1782727300.795129:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fd12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+14:5946:x1869324939709312:12345-0@lo:101: Request processed in 102us (1168us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727300.795135:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1782727300.795237:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c6e380700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939709312:0@lo:101: 00010000:00010000:1.0:1782727300.795253:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff921c43a22e00/0x14a47870ee88cb11 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88cb18 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727300.795269:0:5946:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff921c43a22e00/0x14a47870ee88cb11 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x14a47870ee88cb18 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727300.795329:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c6e380700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939709440:0@lo:501: 00000100:00100000:1.0:1782727300.795356:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727300.795387:0:5946:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c58a36540 going to sleep for 11 seconds 00000100:00100000:2.0:1782727300.795491:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939709440 00000100:00100000:2.0:1782727300.795495:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939709440 00000100:00100000:2.0:1782727300.795528:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1782727300.795534:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fd11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+14:5946:x1869324939709440:12345-0@lo:501: 00000100:00100000:2.0:1782727300.795649:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fd11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+14:5946:x1869324939709440:12345-0@lo:501: Request processed in 115us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727300.795656:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1782727300.795775:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c6e380700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939709440:0@lo:501: 00000100:00100000:1.0:1782727300.795802:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c6e380700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939709568:0@lo:503: 00000100:00100000:1.0:1782727300.795838:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727300.795859:0:5946:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c58a36540 going to sleep for 11 seconds 00000100:00100000:2.0:1782727300.795957:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939709568 00000100:00100000:2.0:1782727300.795966:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939709568 00000100:00100000:2.0:1782727300.795995:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1782727300.796001:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fd10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+14:5946:x1869324939709568:12345-0@lo:503: 00000100:00100000:2.0:1782727300.796069:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fd10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+14:5946:x1869324939709568:12345-0@lo:503: Request processed in 67us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727300.796075:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1782727300.796155:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c6e380700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939709568:0@lo:503: 00000100:00100000:1.0:1782727300.800635:0:8454:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c6e380700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c71e9f0f-6441-4b9b-bc96-153ab9250801:8454:1869324939709696:0@lo:502: 00000100:00100000:1.0:1782727300.800721:0:8454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727300.800769:0:8454:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c5d111240 going to sleep for 11 seconds 00000100:00100000:0.0:1782727300.800818:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939709696 00000100:00100000:0.0:1782727300.800825:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939709696 00000100:00100000:0.0:1782727300.800872:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1782727300.800903:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fd11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+14:8454:x1869324939709696:12345-0@lo:502: 00000100:00100000:0.0:1782727300.801023:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fd11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+14:8454:x1869324939709696:12345-0@lo:502: Request processed in 142us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727300.801031:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1782727300.801084:0:8454:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c6e380700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c71e9f0f-6441-4b9b-bc96-153ab9250801:8454:1869324939709696:0@lo:502: 00000100:00100000:0.0:1782727300.801129:0:8454:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c76443b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c71e9f0f-6441-4b9b-bc96-153ab9250801:8454:1869324939709824:0@lo:502: 00000100:00100000:0.0:1782727300.801155:0:8454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727300.801186:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939709824 00000100:00100000:0.0:1782727300.801189:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939709824 00000100:00100000:0.0:1782727300.801217:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1782727300.801222:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fd12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+14:8454:x1869324939709824:12345-0@lo:502: 00000100:00100000:0.0:1782727300.801269:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fd12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+14:8454:x1869324939709824:12345-0@lo:502: Request processed in 46us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727300.801275:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1782727300.801298:0:8454:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c45315f00 going to sleep for 11 seconds 00000100:00100000:0.0:1782727300.801308:0:8454:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c76443b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c71e9f0f-6441-4b9b-bc96-153ab9250801:8454:1869324939709824:0@lo:502: 00000040:00080000:0.0:1782727300.801324:0:8454:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1782727300.801368:0:5946:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1782727300.801386:0:5946:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1782727300.801394:0:5946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff921c43a22e00/0x14a47870ee88cb11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88cb18 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727300.801405:0:5946:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff921c43a22e00/0x14a47870ee88cb11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88cb18 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782727300.801413:0:5946:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1782727300.801415:0:5946:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1782727300.801418:0:5946:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1782727300.801441:0:5946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff921c7a3e0a00/0x14a47870ee88cb1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727300.801449:0:5946:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff921c7a3e0a00/0x14a47870ee88cb1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727300.801458:0:5946:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff921c7a3e0a00/0x14a47870ee88cb1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727300.801468:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c76443b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939709952:0@lo:101: 00000100:00100000:0.0:1782727300.801491:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727300.801503:0:5946:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c45315f00 going to sleep for 11 seconds 00000100:00100000:0.0:1782727300.801514:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939709952 00000100:00100000:0.0:1782727300.801517:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939709952 00000100:00100000:0.0:1782727300.801537:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1782727300.801543:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fd13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+14:5946:x1869324939709952:12345-0@lo:101: 00010000:00010000:0.0:1782727300.801550:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727300.801561:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921c7a3e0e00/0x14a47870ee88cb26 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x14a47870ee88cb1f expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727300.801581:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921c7a3e0e00/0x14a47870ee88cb26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x14a47870ee88cb1f expref: 15 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727300.801591:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921c7a3e0e00/0x14a47870ee88cb26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x14a47870ee88cb1f expref: 15 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727300.801598:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c7a3e0e00, rc 0) 00000100:00100000:0.0:1782727300.801623:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fd13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+15:5946:x1869324939709952:12345-0@lo:101: Request processed in 80us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727300.801629:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1782727300.801663:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c76443b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939709952:0@lo:101: 00010000:00010000:0.0:1782727300.801674:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff921c7a3e0a00/0x14a47870ee88cb1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88cb26 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727300.801682:0:5946:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff921c7a3e0a00/0x14a47870ee88cb1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x14a47870ee88cb26 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727300.801721:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c76443b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939710080:0@lo:501: 00000100:00100000:0.0:1782727300.801744:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727300.801757:0:5946:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c45315f00 going to sleep for 11 seconds 00000100:00100000:0.0:1782727300.801767:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939710080 00000100:00100000:0.0:1782727300.801771:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939710080 00000100:00100000:0.0:1782727300.801788:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1782727300.801793:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fd10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+15:5946:x1869324939710080:12345-0@lo:501: 00000100:00100000:0.0:1782727300.801880:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fd10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+15:5946:x1869324939710080:12345-0@lo:501: Request processed in 86us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727300.801906:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1782727300.801934:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c76443b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939710080:0@lo:501: 00000100:00100000:0.0:1782727300.801956:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c76443b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939710208:0@lo:503: 00000100:00100000:0.0:1782727300.801985:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727300.801997:0:5946:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c45315f00 going to sleep for 11 seconds 00000100:00100000:0.0:1782727300.802008:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939710208 00000100:00100000:0.0:1782727300.802011:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939710208 00000100:00100000:0.0:1782727300.802029:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1782727300.802035:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fd12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+15:5946:x1869324939710208:12345-0@lo:503: 00000100:00100000:0.0:1782727300.802099:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fd12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+15:5946:x1869324939710208:12345-0@lo:503: Request processed in 64us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727300.802113:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1782727300.802147:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c76443b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939710208:0@lo:503: 00000100:00100000:1.0:1782727300.803220:0:8455:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c6e381c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c71e9f0f-6441-4b9b-bc96-153ab9250801:8455:1869324939710336:0@lo:502: 00000100:00100000:1.0:1782727300.803265:0:8455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727300.803304:0:8455:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c5d111a80 going to sleep for 11 seconds 00000100:00100000:2.0:1782727300.803413:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939710336 00000100:00100000:2.0:1782727300.803418:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939710336 00000100:00100000:2.0:1782727300.803455:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1782727300.803464:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fd13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+15:8455:x1869324939710336:12345-0@lo:502: 00000100:00100000:2.0:1782727300.803548:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fd13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+15:8455:x1869324939710336:12345-0@lo:502: Request processed in 85us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727300.803554:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1782727300.803759:0:8455:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c6e381c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c71e9f0f-6441-4b9b-bc96-153ab9250801:8455:1869324939710336:0@lo:502: 00000020:01000000:1.0:1782727300.803786:0:8455:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782727300.803795:0:8455:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782727300.803797:0:8455:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1782727300.803802:0:8455:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1782727300.803804:0:8455:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1782727300.803819:0:8455:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c6e381c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c71e9f0f-6441-4b9b-bc96-153ab9250801:8455:1869324939710464:0@lo:502: 00000100:00100000:1.0:1782727300.803856:0:8455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727300.803905:0:8455:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c5d111a80 going to sleep for 11 seconds 00000100:00100000:2.0:1782727300.803962:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939710464 00000100:00100000:2.0:1782727300.803966:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939710464 00000100:00100000:2.0:1782727300.803994:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1782727300.804002:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fd11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+15:8455:x1869324939710464:12345-0@lo:502: 00000100:00100000:2.0:1782727300.804071:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fd11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+15:8455:x1869324939710464:12345-0@lo:502: Request processed in 68us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727300.804077:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1782727300.804188:0:8455:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c6e381c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c71e9f0f-6441-4b9b-bc96-153ab9250801:8455:1869324939710464:0@lo:502: 00000020:01000000:1.0:1782727300.804288:0:8455:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782727300.804293:0:8455:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782727300.804295:0:8455:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:1.0:1782727300.804299:0:8455:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:2.0:1782727300.812756:0:5946:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1782727300.812793:0:5946:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1782727300.812805:0:5946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff921c7a3e0a00/0x14a47870ee88cb1f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88cb26 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727300.812815:0:5946:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff921c7a3e0a00/0x14a47870ee88cb1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88cb26 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782727300.812845:0:5946:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1782727300.812848:0:5946:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff921c479c5800 from 30 10000000:01000000:2.0:1782727300.812850:0:5946:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1782727300.812906:0:5946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff921c429d4a00/0x14a47870ee88cb2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727300.812914:0:5946:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff921c429d4a00/0x14a47870ee88cb2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727300.812924:0:5946:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff921c429d4a00/0x14a47870ee88cb2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727300.812948:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e41880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939710592:0@lo:101: 00000100:00100000:2.0:1782727300.813012:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727300.813127:0:5946:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c42de49c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782727300.813742:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939710592 00000100:00100000:1.0:1782727300.813751:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939710592 00000100:00100000:1.0:1782727300.813808:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1782727300.813817:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6dd3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+15:5946:x1869324939710592:12345-0@lo:101: 00010000:00010000:1.0:1782727300.813834:0:5943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727300.813848:0:5943:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921c43a22800/0x14a47870ee88cb34 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x14a47870ee88cb2d expref: -99 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727300.813873:0:5943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921c43a22800/0x14a47870ee88cb34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x14a47870ee88cb2d expref: 16 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727300.813899:0:5943:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921c43a22800/0x14a47870ee88cb34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x14a47870ee88cb2d expref: 16 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727300.813908:0:5943:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c43a22800, rc 0) 00000100:00100000:1.0:1782727300.813958:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6dd3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+16:5946:x1869324939710592:12345-0@lo:101: Request processed in 142us (946us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727300.813965:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1782727300.814837:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e41880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939710592:0@lo:101: 00010000:00010000:1.0:1782727300.814856:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff921c429d4a00/0x14a47870ee88cb2d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88cb34 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727300.814880:0:5946:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff921c429d4a00/0x14a47870ee88cb2d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x14a47870ee88cb34 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727300.814970:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c6e381c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939710720:0@lo:501: 00000100:00100000:1.0:1782727300.815008:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727300.815382:0:5946:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c5d111240 going to sleep for 11 seconds 00000100:00100000:1.0:1782727300.815401:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939710720 00000100:00100000:1.0:1782727300.815405:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939710720 00000100:00100000:1.0:1782727300.815821:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1782727300.815831:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6dd3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+16:5946:x1869324939710720:12345-0@lo:501: 00000100:00100000:1.0:1782727300.815965:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6dd3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+16:5946:x1869324939710720:12345-0@lo:501: Request processed in 135us (956us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727300.815972:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1782727300.816007:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c6e381c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939710720:0@lo:501: 00000100:00100000:1.0:1782727300.816203:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c6e381c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939710848:0@lo:503: 00000100:00100000:1.0:1782727300.816242:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727300.816266:0:5946:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c5d111240 going to sleep for 11 seconds 00000100:00100000:1.0:1782727300.816277:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939710848 00000100:00100000:1.0:1782727300.816281:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939710848 00000100:00100000:1.0:1782727300.816301:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1782727300.816306:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6dd3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+16:5946:x1869324939710848:12345-0@lo:503: 00000100:00100000:1.0:1782727300.816366:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6dd3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+16:5946:x1869324939710848:12345-0@lo:503: Request processed in 59us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727300.816372:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1782727300.816404:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c6e381c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939710848:0@lo:503: 00000100:00100000:1.0:1782727300.816595:0:8456:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c6e381c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c71e9f0f-6441-4b9b-bc96-153ab9250801:8456:1869324939710976:0@lo:502: 00000100:00100000:1.0:1782727300.816847:0:8456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727300.816873:0:8456:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c5d111240 going to sleep for 11 seconds 00000100:00100000:2.0:1782727300.818743:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939710976 00000100:00100000:2.0:1782727300.818756:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939710976 00000100:00100000:2.0:1782727300.818811:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1782727300.818820:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6dd3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+16:8456:x1869324939710976:12345-0@lo:502: 00000100:00100000:2.0:1782727300.818977:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6dd3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+16:8456:x1869324939710976:12345-0@lo:502: Request processed in 157us (2129us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727300.818984:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1782727300.819503:0:8456:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c6e381c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c71e9f0f-6441-4b9b-bc96-153ab9250801:8456:1869324939710976:0@lo:502: 00000100:00100000:1.0:1782727300.819574:0:8456:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c6e381c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c71e9f0f-6441-4b9b-bc96-153ab9250801:8456:1869324939711104:0@lo:502: 00000100:00100000:1.0:1782727300.820312:0:8456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727300.820344:0:8456:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c58a36540 going to sleep for 11 seconds 00000100:00100000:2.0:1782727300.820424:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939711104 00000100:00100000:2.0:1782727300.820430:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939711104 00000100:00100000:2.0:1782727300.820476:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1782727300.820484:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6dd3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+16:8456:x1869324939711104:12345-0@lo:502: 00000100:00100000:2.0:1782727300.820593:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6dd3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+16:8456:x1869324939711104:12345-0@lo:502: Request processed in 109us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727300.820618:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1782727300.820767:0:8456:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c6e381c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c71e9f0f-6441-4b9b-bc96-153ab9250801:8456:1869324939711104:0@lo:502: 00000040:00080000:1.0:1782727300.820792:0:8456:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1782727300.820966:0:5946:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1782727300.820987:0:5946:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782727300.820996:0:5946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff921c429d4a00/0x14a47870ee88cb2d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88cb34 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727300.821007:0:5946:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff921c429d4a00/0x14a47870ee88cb2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88cb34 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782727300.821017:0:5946:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1782727300.821019:0:5946:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff921c479c5800 from 5 10000000:01000000:2.0:1782727300.821031:0:5946:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1782727300.821057:0:5946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff921c429d5200/0x14a47870ee88cb3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727300.821065:0:5946:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff921c429d5200/0x14a47870ee88cb3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727300.821074:0:5946:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff921c429d5200/0x14a47870ee88cb3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727300.821089:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e41500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939711232:0@lo:101: 00000100:00100000:2.0:1782727300.821116:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727300.821144:0:5946:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c42de4300 going to sleep for 11 seconds 00000100:00100000:1.0:1782727300.821310:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939711232 00000100:00100000:1.0:1782727300.821315:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939711232 00000100:00100000:1.0:1782727300.821346:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1782727300.821353:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6dd3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+16:5946:x1869324939711232:12345-0@lo:101: 00010000:00010000:1.0:1782727300.821361:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727300.821373:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921c43a23c00/0x14a47870ee88cb42 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x14a47870ee88cb3b expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727300.821392:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921c43a23c00/0x14a47870ee88cb42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x14a47870ee88cb3b expref: 17 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727300.821402:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921c43a23c00/0x14a47870ee88cb42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x14a47870ee88cb3b expref: 17 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727300.821411:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c43a23c00, rc 0) 00000100:00100000:1.0:1782727300.821437:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6dd3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+17:5946:x1869324939711232:12345-0@lo:101: Request processed in 85us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727300.821443:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1782727300.821513:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e41500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939711232:0@lo:101: 00010000:00010000:2.0:1782727300.821525:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff921c429d5200/0x14a47870ee88cb3b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88cb42 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727300.821533:0:5946:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff921c429d5200/0x14a47870ee88cb3b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x14a47870ee88cb42 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727300.821581:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e41500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939711360:0@lo:256: 00000100:00100000:2.0:1782727300.821686:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727300.821706:0:5946:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c42de4300 going to sleep for 11 seconds 00000100:00100000:1.0:1782727300.821754:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939711360 00000100:00100000:1.0:1782727300.821758:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939711360 00000100:00100000:1.0:1782727300.821787:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1782727300.821793:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6dd3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+17:5946:x1869324939711360:12345-0@lo:256: 20000000:01000000:1.0:1782727300.821804:0:5942:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1782727300.821821:0:5942:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1782727300.821824:0:5942:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1782727300.821917:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6dd3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+17:5946:x1869324939711360:12345-0@lo:256: Request processed in 123us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727300.821923:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1782727300.821995:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e41500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939711360:0@lo:256: 10000000:01000000:2.0:1782727300.822113:0:5946:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1782727300.822120:0:5946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff921c429d5200/0x14a47870ee88cb3b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88cb42 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727300.822127:0:5946:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff921c429d5200/0x14a47870ee88cb3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88cb42 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782727300.822134:0:5946:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1782727300.822136:0:5946:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1782727300.822139:0:5946:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1782727300.822155:0:5946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff921c429d4600/0x14a47870ee88cb49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727300.822162:0:5946:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff921c429d4600/0x14a47870ee88cb49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727300.822180:0:5946:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff921c429d4600/0x14a47870ee88cb49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727300.822272:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e41500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939711488:0@lo:101: 00000100:00100000:2.0:1782727300.822300:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727300.822361:0:5946:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c42de4300 going to sleep for 11 seconds 00000100:00100000:1.0:1782727300.826750:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939711488 00000100:00100000:1.0:1782727300.826764:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939711488 00000100:00100000:1.0:1782727300.826808:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1782727300.826817:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6dd3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+17:5946:x1869324939711488:12345-0@lo:101: 00010000:00010000:1.0:1782727300.826833:0:5943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727300.826848:0:5943:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921c43a22400/0x14a47870ee88cb50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x14a47870ee88cb49 expref: -99 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727300.826876:0:5943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921c43a22400/0x14a47870ee88cb50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x14a47870ee88cb49 expref: 18 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727300.826899:0:5943:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921c43a22400/0x14a47870ee88cb50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x14a47870ee88cb49 expref: 18 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727300.826909:0:5943:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c43a22400, rc 0) 00000100:00100000:1.0:1782727300.826971:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6dd3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+18:5946:x1869324939711488:12345-0@lo:101: Request processed in 155us (4669us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727300.826977:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1782727300.827226:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e41500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939711488:0@lo:101: 00010000:00010000:2.0:1782727300.827256:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff921c429d4600/0x14a47870ee88cb49 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88cb50 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727300.827265:0:5946:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff921c429d4600/0x14a47870ee88cb49 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x14a47870ee88cb50 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727300.827332:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e41500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939711616:0@lo:501: 00000100:00100000:2.0:1782727300.827363:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727300.827390:0:5946:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c42de4300 going to sleep for 11 seconds 00000100:00100000:2.0:1782727300.827402:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939711616 00000100:00100000:2.0:1782727300.827405:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939711616 00000100:00100000:2.0:1782727300.827426:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1782727300.827432:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6dd3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+18:5946:x1869324939711616:12345-0@lo:501: 00000100:00100000:2.0:1782727300.827521:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6dd3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+18:5946:x1869324939711616:12345-0@lo:501: Request processed in 89us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727300.827527:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1782727300.827550:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e41500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939711616:0@lo:501: 00000100:00100000:2.0:1782727300.827570:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e41500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939711744:0@lo:503: 00000100:00100000:2.0:1782727300.827612:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727300.831782:0:5946:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c42de4300 going to sleep for 11 seconds 00000100:00100000:2.0:1782727300.831812:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939711744 00000100:00100000:2.0:1782727300.831819:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939711744 00000100:00100000:2.0:1782727300.831863:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1782727300.831871:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6dd3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+18:5946:x1869324939711744:12345-0@lo:503: 00000100:00100000:2.0:1782727300.832005:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6dd3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+18:5946:x1869324939711744:12345-0@lo:503: Request processed in 134us (4392us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727300.832013:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1782727300.832084:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e41500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939711744:0@lo:503: 00000100:00100000:2.0:1782727300.832309:0:8457:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e41500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c71e9f0f-6441-4b9b-bc96-153ab9250801:8457:1869324939711872:0@lo:502: 00000100:00100000:2.0:1782727300.832345:0:8457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727300.832361:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939711872 00000100:00100000:2.0:1782727300.832364:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939711872 00000100:00100000:2.0:1782727300.832382:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1782727300.832387:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6dd3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+18:8457:x1869324939711872:12345-0@lo:502: 00000100:00100000:2.0:1782727300.832443:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6dd3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+18:8457:x1869324939711872:12345-0@lo:502: Request processed in 55us (97us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727300.832449:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1782727300.832477:0:8457:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c42de4900 going to sleep for 11 seconds 00000100:00100000:2.0:1782727300.832487:0:8457:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e41500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c71e9f0f-6441-4b9b-bc96-153ab9250801:8457:1869324939711872:0@lo:502: 00000020:01000000:2.0:1782727300.832505:0:8457:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1782727300.832511:0:8457:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1782727300.832518:0:8457:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782727300.832520:0:8457:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1782727300.832526:0:8457:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1782727300.832531:0:8457:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.160@tcp to nid 0x20000c0a8caa0 (192.168.202.160@tcp) 00000020:01000000:2.0:1782727300.832553:0:8457:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1782727300.832556:0:8457:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1782727300.832572:0:8457:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff921c431b0000) 00000020:00000080:2.0:1782727300.832592:0:8457:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1782727300.832608:0:8457:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1782727300.832680:0:8457:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1782727300.832687:0:8457:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:2.0:1782727300.832694:0:8457:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x14a47870ee88cb5e 00010000:00080000:2.0:1782727300.832721:0:8457:0:(ldlm_lib.c:102:import_set_conn()) imp ffff921c42d17000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.160@tcp at head 00010000:00010000:2.0:1782727300.832944:0:8457:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:2.0:1782727300.833051:0:8457:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1782727300.833061:0:8457:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1782727300.833259:0:8457:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782727300.833396:0:8457:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782727300.833557:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1782727300.833642:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1782727300.839459:0:8458:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782727300.839467:0:8458:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1782727300.840142:0:8457:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1782727300.840153:0:8457:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1782727300.840265:0:8457:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1782727300.840288:0:8457:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x14a47870ee88cb65 00000100:00080000:0.0:1782727300.840300:0:8457:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1782727300.840305:0:8457:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff921c42d17000 using connection 192.168.202.160@tcp/0@lo 00000100:00100000:0.0:1782727300.840337:0:8457:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff921c76443b80 x1869324939712000/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1782727300.840360:0:8457:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:3.0:1782727300.840423:0:3441:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c76443b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3441:1869324939712000:0@lo:8: 00000100:00100000:3.0:1782727300.840487:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727300.841581:0:6950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939712000 00000100:00100000:1.0:1782727300.841606:0:6950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939712000 00000100:00100000:1.0:1782727300.841640:0:6950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782727300.841647:0:6950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c45e44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3441:x1869324939712000:12345-0@lo:8: 00010000:00080000:1.0:1782727300.841671:0:6950:0:(ldlm_lib.c:1434:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 195 last 0 00000020:00000080:1.0:1782727300.841694:0:6950:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x14a47870ee88cb6c 00002000:00100000:1.0:1782727300.841706:0:6950:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff921c7d8c1800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1782727300.841710:0:6950:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1782727300.841714:0:6950:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1782727300.841769:0:6950:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1782727300.841961:0:6950:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1782727300.841981:0:6950:0:(import.c:65:import_set_state_nolock()) ffff921c7d8c4800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782727300.842051:0:6950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c45e44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3441:x1869324939712000:12345-0@lo:8: Request processed in 404us (1564us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727300.842058:0:6950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1782727300.842099:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c76443b80 x1869324939712000/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782727310 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727300.842111:0:3441:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1782727300.842118:0:3441:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1782727300.842124:0:3441:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1782727300.842128:0:3441:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1782727300.842130:0:3441:0:(import.c:65:import_set_state_nolock()) ffff921c42d17000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1782727300.842141:0:3441:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1782727300.842146:0:3441:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c76443b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3441:1869324939712000:0@lo:8: 00000004:00080000:1.0:1782727300.843308:0:8458:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1782727300.843390:0:8458:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 195601505684ns, next at 0ns, rc = 0 00080000:00080000:1.0:1782727300.843397:0:8458:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1782727300.843879:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782727300.843916:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869324939712128:0@lo:400: 00000100:00100000:2.0:1782727300.843972:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727300.844011:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939712128 00000100:00100000:2.0:1782727300.844017:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939712128 00000100:00100000:2.0:1782727300.844062:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1782727300.844070:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c45e41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869324939712128:12345-0@lo:400: 00000100:00100000:2.0:1782727300.844114:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c45e41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869324939712128:12345-0@lo:400: Request processed in 44us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727300.844121:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1782727300.844160:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c45e41500 x1869324939712128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727300.844185:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869324939712128:0@lo:400: 00000100:00100000:3.0:1782727300.846354:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3443:1869324939712384:0@lo:400: 00000100:00100000:3.0:1782727300.846417:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727300.846451:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782727300.846458:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3443:1869324939712256:0@lo:400: 00000100:00100000:3.0:1782727300.846493:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1782727300.846920:0:8457:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782727300.846928:0:8457:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782727300.846931:0:8457:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1782727300.846934:0:8457:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782727300.846938:0:8457:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782727300.846940:0:8457:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1782727300.846942:0:8457:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1782727300.846944:0:8457:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1782727300.846979:0:8457:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c76442680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c71e9f0f-6441-4b9b-bc96-153ab9250801:8457:1869324939712512:0@lo:502: 00000100:00100000:0.0:1782727300.847029:0:8457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727300.847059:0:8457:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c453150c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782727300.848863:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939712384 00000100:00100000:1.0:1782727300.848920:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939712384 00000100:00100000:1.0:1782727300.848977:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939712256 00000100:00100000:1.0:1782727300.848981:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939712256 00000100:00100000:1.0:1782727300.848997:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1782727300.849006:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c45e46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1869324939712384:12345-0@lo:400: 00000100:00100000:1.0:1782727300.849081:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c45e46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1869324939712384:12345-0@lo:400: Request processed in 76us (2664us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727300.849088:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1782727300.849103:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1782727300.849108:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c45e44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1869324939712256:12345-0@lo:400: 00000100:00100000:1.0:1782727300.849133:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c45e44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1869324939712256:12345-0@lo:400: Request processed in 26us (2639us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727300.849139:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1782727300.849310:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c45e40000 x1869324939712256/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727300.849325:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3443:1869324939712256:0@lo:400: 00010000:00080000:1.0:1782727300.849337:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c45e41180 x1869324939712384/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727300.849346:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3443:1869324939712384:0@lo:400: 00000100:00080000:0.0:1782727300.849608:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:1.0:1782727300.850543:0:5929:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1782727300.853300:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782727300.853323:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869324939712640:0@lo:13: 00000100:00100000:3.0:1782727300.853390:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1782727300.853437:0:8459:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1782727300.853464:0:8459:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e45500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8459:1869324939712768:0@lo:7: 00000100:00100000:3.0:1782727300.853485:0:8459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727300.853506:0:6949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939712768 00000100:00100000:3.0:1782727300.853512:0:6949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939712768 00000100:00100000:3.0:1782727300.853560:0:6949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782727300.853568:0:6949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c45e46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8459:x1869324939712768:12345-0@lo:7: 00000100:00080000:0.0:1782727300.854698:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782727300.855365:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939712512 00000100:00100000:0.0:1782727300.855374:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939712512 00000100:00100000:0.0:1782727300.855438:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1782727300.855447:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6dd3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+18:8457:x1869324939712512:12345-0@lo:502: 00000100:00100000:0.0:1782727300.855625:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6dd3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+18:8457:x1869324939712512:12345-0@lo:502: Request processed in 179us (8595us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727300.855632:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1782727300.857035:0:8457:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c76442680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c71e9f0f-6441-4b9b-bc96-153ab9250801:8457:1869324939712512:0@lo:502: 00000020:01000000:0.0:1782727300.857077:0:8457:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782727300.857086:0:8457:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782727300.857089:0:8457:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:0.0:1782727300.857093:0:8457:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:1.0:1782727300.858949:0:5946:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1782727300.858981:0:5946:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1782727300.858992:0:5946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff921c429d4600/0x14a47870ee88cb49 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88cb50 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727300.859004:0:5946:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff921c429d4600/0x14a47870ee88cb49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88cb50 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782727300.859026:0:5946:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1782727300.859029:0:5946:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff921c519f0000 from 1 10000000:01000000:1.0:1782727300.859032:0:5946:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1782727300.859065:0:5946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff921c43a22600/0x14a47870ee88cb73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727300.859074:0:5946:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff921c43a22600/0x14a47870ee88cb73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727300.859083:0:5946:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff921c43a22600/0x14a47870ee88cb73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727300.859102:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c6e381c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939712896:0@lo:101: 00000100:00100000:1.0:1782727300.859181:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727300.859229:0:5946:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c7d6c1f00 going to sleep for 11 seconds 00000100:00100000:1.0:1782727300.859254:0:6952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939712640 00000100:00100000:1.0:1782727300.859260:0:6952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939712640 00000100:00100000:1.0:1782727300.859298:0:6952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782727300.859306:0:6952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c45e44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3445:x1869324939712640:12345-0@lo:13: 00002000:00000024:1.0:1782727300.859332:0:6952:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923914752 avail 3692392448 00000100:00100000:1.0:1782727300.859387:0:6952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c45e44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3445:x1869324939712640:12345-0@lo:13: Request processed in 81us (5996us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727300.859394:0:6952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1782727300.859442:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c45e44000 x1869324939712640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727316 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727300.859460:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869324939712640:0@lo:13: 00000100:00100000:2.0:1782727300.859968:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939712896 00000100:00100000:2.0:1782727300.859975:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939712896 00000100:00100000:2.0:1782727300.860011:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1782727300.860018:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6dd3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+18:5946:x1869324939712896:12345-0@lo:101: 00010000:00010000:2.0:1782727300.860028:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727300.860041:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921c429d5600/0x14a47870ee88cb7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x14a47870ee88cb73 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727300.860061:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921c429d5600/0x14a47870ee88cb7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x14a47870ee88cb73 expref: 19 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727300.860081:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921c429d5600/0x14a47870ee88cb7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x14a47870ee88cb73 expref: 19 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727300.860088:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c429d5600, rc 0) 00000100:00100000:2.0:1782727300.860128:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6dd3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:5946:x1869324939712896:12345-0@lo:101: Request processed in 109us (946us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727300.860134:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1782727300.860739:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c6e381c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939712896:0@lo:101: 00010000:00010000:2.0:1782727300.860757:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff921c43a22600/0x14a47870ee88cb73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88cb7a expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727300.860767:0:5946:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff921c43a22600/0x14a47870ee88cb73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x14a47870ee88cb7a expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727300.860836:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e41500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939713024:0@lo:501: 00000100:00100000:2.0:1782727300.860870:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727300.860934:0:5946:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c42de40c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782727300.860981:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939713024 00000100:00100000:1.0:1782727300.860992:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939713024 00000100:00100000:1.0:1782727300.861023:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1782727300.861030:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6dd3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:5946:x1869324939713024:12345-0@lo:501: 00000100:00100000:1.0:1782727300.861095:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6dd3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:5946:x1869324939713024:12345-0@lo:501: Request processed in 65us (225us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782727300.861102:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1782727300.868839:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e41500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939713024:0@lo:501: 10000000:01000000:2.0:1782727300.868914:0:5946:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1782727300.868924:0:5946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff921c43a22600/0x14a47870ee88cb73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88cb7a expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727300.868935:0:5946:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff921c43a22600/0x14a47870ee88cb73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88cb7a expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727300.869333:0:8459:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c7668dc00 going to sleep for 11 seconds 00002000:00080000:3.0:1782727300.884539:0:6949:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1782727300.884547:0:6949:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1782727300.886942:0:6949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c45e46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8459:x1869324939712768:12345-0@lo:7: Request processed in 33365us (33446us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727300.886955:0:6949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1782727300.894370:0:8459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c45e45500 x1869324939712768/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1782727316 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727300.894389:0:8459:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e45500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8459:1869324939712768:0@lo:7: 00000004:00080000:0.0:1782727300.894405:0:8459:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1782727300.894464:0:8459:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c76442680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8459:1869324939713152:0@lo:5: 00000100:00100000:0.0:1782727300.894519:0:8459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727300.895433:0:8459:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c5152f780 going to sleep for 11 seconds 00000100:00100000:3.0:1782727300.906019:0:6951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939713152 00000100:00100000:3.0:1782727300.906034:0:6951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939713152 00000100:00100000:3.0:1782727300.906094:0:6951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782727300.906104:0:6951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c76443100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8459:x1869324939713152:12345-0@lo:5: 00002000:00080000:3.0:1782727300.906134:0:6951:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1782727300.906138:0:6951:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000001:00080000:0.0:1782727300.912667:0:8019:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:0.0:1782727300.912689:0:8019:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1782727300.914425:0:6951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c76443100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8459:x1869324939713152:12345-0@lo:5: Request processed in 8314us (19896us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1782727300.914437:0:6951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1782727300.914742:0:8459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c76442680 x1869324939713152/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782727316 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727300.914765:0:8459:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1782727300.914772:0:8459:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c76442680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8459:1869324939713152:0@lo:5: 00000004:00080000:0.0:1782727300.914787:0:8459:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1782727300.914837:0:8459:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c76442680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8459:1869324939713280:0@lo:700: 00000100:00100000:0.0:1782727300.914911:0:8459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727300.914952:0:8459:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c5152f780 going to sleep for 11 seconds 00000100:00100000:2.0:1782727300.915349:0:6957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939713280 00000100:00100000:2.0:1782727300.915363:0:6957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939713280 00000100:00100000:2.0:1782727300.915470:0:6957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782727300.915480:0:6957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c76440700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8459:x1869324939713280:12345-0@lo:700: 00000100:00100000:2.0:1782727300.915519:0:6957:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e41500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6957:1869324939713408:0@lo:700: 00000100:00100000:2.0:1782727300.915552:0:6957:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727300.915572:0:6957:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c42de40c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782727300.918198:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939713408 00000100:00100000:0.0:1782727300.918209:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939713408 00000100:00100000:0.0:1782727300.918262:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782727300.918274:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c45e41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6957:x1869324939713408:12345-0@lo:700: 40000000:02000000:3.0:1782727300.931989:0:5956:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:2.0:1782727300.947377:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c45e41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6957:x1869324939713408:12345-0@lo:700: Request processed in 29097us (31815us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727300.947397:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1782727300.948006:0:6957:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c45e41500 x1869324939713408/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1782727316 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727300.948029:0:6957:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e41500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6957:1869324939713408:0@lo:700: 40000000:02000000:3.0:1782727300.948042:0:6957:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:0.0:1782727300.981556:0:6957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c76440700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8459:x1869324939713280:12345-0@lo:700: Request processed in 66069us (66637us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727300.981572:0:6957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1782727300.981872:0:8459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c76442680 x1869324939713280/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1782727316 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727300.981914:0:8459:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c76442680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8459:1869324939713280:0@lo:700: 00000004:02000040:3.0:1782727300.996837:0:8459:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1782727301.002401:0:8459:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e45180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8459:1869324939713536:0@lo:5: 00000100:00100000:3.0:1782727301.002472:0:8459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727301.002579:0:8459:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c7d924840 going to sleep for 11 seconds 00000100:00100000:0.0:1782727301.002764:0:6949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939713536 00000100:00100000:0.0:1782727301.002773:0:6949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939713536 00000100:00100000:0.0:1782727301.002834:0:6949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782727301.002843:0:6949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c45e45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8459:x1869324939713536:12345-0@lo:5: 00002000:00080000:0.0:1782727301.012817:0:6949:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1782727301.012836:0:6949:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1782727301.015396:0:6949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c45e45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8459:x1869324939713536:12345-0@lo:5: Request processed in 12547us (12917us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1782727301.015408:0:6949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1782727301.015503:0:8459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c45e45180 x1869324939713536/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782727317 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727301.015520:0:8459:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e45180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8459:1869324939713536:0@lo:5: 00000004:00080000:3.0:1782727301.015533:0:8459:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000001:00080000:0.0:1782727301.226069:0:8019:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:3.0:1782727301.562532:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727302.588837:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1782727303.149337:0:8537:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1782727303.149529:0:8537:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1782727303.609089:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1782727304.361198:0:8585:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1782727304.361214:0:8585:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:3.0:1782727304.633727:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727304.869371:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1782727304.869528:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914524288 00000100:00100000:2.0:1782727304.869541:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914524288 00000100:00100000:2.0:1782727304.869613:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 112 00000100:00100000:2.0:1782727304.869624:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6dd3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2354:x1869324914524288:12345-192.168.202.60@tcp:250: 00010000:00080000:2.0:1782727304.869665:0:5943:0:(ldlm_lib.c:1434:target_handle_connect()) MGS: connection from ecaf1fda-ff42-4054-9f39-8e142296107b@192.168.202.60@tcp t0 exp 0000000000000000 cur 199 last 0 00000020:00000080:2.0:1782727304.869703:0:5943:0:(genops.c:1406:class_connect()) connect: client ecaf1fda-ff42-4054-9f39-8e142296107b, cookie 0x14a47870ee88cb81 00000100:00080000:2.0:1782727304.869901:0:5943:0:(import.c:65:import_set_state_nolock()) ffff921c7df1a800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782727304.869992:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6dd3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecaf1fda-ff42-4054-9f39-8e142296107b+5:2354:x1869324914524288:12345-192.168.202.60@tcp:250: Request processed in 368us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727304.870002:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 112 00000100:00100000:2.0:1782727304.881160:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1782727304.881256:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914524416 00000100:00100000:0.0:1782727304.881269:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914524416 00000100:00100000:0.0:1782727304.881335:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 113 00000100:00100000:0.0:1782727304.881346:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6dd3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecaf1fda-ff42-4054-9f39-8e142296107b+5:5444:x1869324914524416:12345-192.168.202.60@tcp:101: 00010000:00010000:0.0:1782727304.881367:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727304.881387:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921c7a3e1a00/0x14a47870ee88cb88 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x1752a87bbfbdf034 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727304.881445:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921c7a3e1a00/0x14a47870ee88cb88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf034 expref: 6 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727304.881456:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921c7a3e1a00/0x14a47870ee88cb88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf034 expref: 6 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727304.881465:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c7a3e1a00, rc 0) 00000100:00100000:0.0:1782727304.881540:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6dd3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecaf1fda-ff42-4054-9f39-8e142296107b+6:5444:x1869324914524416:12345-192.168.202.60@tcp:101: Request processed in 196us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727304.881548:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 113 00000100:00100000:0.0:1782727304.884830:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1782727304.884943:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914524544 00000100:00100000:1.0:1782727304.884954:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914524544 00000100:00100000:1.0:1782727304.885023:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 114 00000100:00100000:1.0:1782727304.885034:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5d073c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecaf1fda-ff42-4054-9f39-8e142296107b+6:5444:x1869324914524544:12345-192.168.202.60@tcp:501: 00000100:00100000:1.0:1782727304.885217:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5d073c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecaf1fda-ff42-4054-9f39-8e142296107b+6:5444:x1869324914524544:12345-192.168.202.60@tcp:501: Request processed in 183us (401us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782727304.885225:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 114 00000100:00100000:3.0:1782727304.891092:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1782727304.891457:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914524672 00000100:00100000:2.0:1782727304.891471:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914524672 00000100:00100000:2.0:1782727304.891549:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 115 00000100:00100000:2.0:1782727304.891561:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5d072850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecaf1fda-ff42-4054-9f39-8e142296107b+6:5444:x1869324914524672:12345-192.168.202.60@tcp:101: 00010000:00010000:2.0:1782727304.891592:0:5943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727304.891622:0:5943:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921c429d5a00/0x14a47870ee88cb8f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x1752a87bbfbdf03b expref: -99 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727304.891681:0:5943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921c429d5a00/0x14a47870ee88cb8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf03b expref: 7 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727304.891695:0:5943:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921c429d5a00/0x14a47870ee88cb8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf03b expref: 7 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727304.891705:0:5943:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c429d5a00, rc 0) 00000100:00100000:2.0:1782727304.891780:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5d072850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecaf1fda-ff42-4054-9f39-8e142296107b+7:5444:x1869324914524672:12345-192.168.202.60@tcp:101: Request processed in 221us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727304.891788:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 115 00000100:00100000:2.0:1782727304.895717:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1782727304.901375:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914524800 00000100:00100000:0.0:1782727304.901397:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914524800 00000100:00100000:1.0:1782727304.901583:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 116 00000100:00100000:1.0:1782727304.901606:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5d070450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecaf1fda-ff42-4054-9f39-8e142296107b+7:5444:x1869324914524800:12345-192.168.202.60@tcp:501: 00000100:00100000:1.0:1782727304.901835:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5d070450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecaf1fda-ff42-4054-9f39-8e142296107b+8:5444:x1869324914524800:12345-192.168.202.60@tcp:501: Request processed in 239us (6130us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727304.901845:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 116 00000100:00100000:0.0:1782727304.910841:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1782727304.911016:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914524928 00000100:00100000:1.0:1782727304.911029:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914524928 00000100:00100000:1.0:1782727304.911178:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 117 00000100:00100000:1.0:1782727304.911191:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5d070850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecaf1fda-ff42-4054-9f39-8e142296107b+8:5444:x1869324914524928:12345-192.168.202.60@tcp:503: 00000100:00100000:1.0:1782727304.911392:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5d070850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecaf1fda-ff42-4054-9f39-8e142296107b+8:5444:x1869324914524928:12345-192.168.202.60@tcp:503: Request processed in 203us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727304.911410:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 117 00000100:00100000:3.0:1782727304.916527:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1782727304.917336:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914525056 00000100:00100000:2.0:1782727304.917352:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914525056 00000100:00100000:2.0:1782727304.917444:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 118 00000100:00100000:2.0:1782727304.917456:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6e0fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecaf1fda-ff42-4054-9f39-8e142296107b+8:5462:x1869324914525056:12345-192.168.202.60@tcp:502: 00000100:00100000:2.0:1782727304.917931:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6e0fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecaf1fda-ff42-4054-9f39-8e142296107b+8:5462:x1869324914525056:12345-192.168.202.60@tcp:502: Request processed in 474us (1417us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727304.917941:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 118 00000100:00100000:3.0:1782727304.973348:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1782727304.983795:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914525184 00000100:00100000:2.0:1782727304.983820:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914525184 00000100:00100000:2.0:1782727304.983939:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 119 00000100:00100000:2.0:1782727304.983951:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6e0fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecaf1fda-ff42-4054-9f39-8e142296107b+8:5462:x1869324914525184:12345-192.168.202.60@tcp:502: 00000100:00100000:2.0:1782727304.984176:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6e0fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecaf1fda-ff42-4054-9f39-8e142296107b+8:5462:x1869324914525184:12345-192.168.202.60@tcp:502: Request processed in 226us (10843us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727304.984185:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 119 00000100:00100000:0.0:1782727304.998294:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1782727304.998416:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914525312 00000100:00100000:1.0:1782727304.998431:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914525312 00000100:00100000:1.0:1782727304.998507:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 120 00000100:00100000:1.0:1782727304.998518:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6e0fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecaf1fda-ff42-4054-9f39-8e142296107b+8:5444:x1869324914525312:12345-192.168.202.60@tcp:101: 00010000:00010000:1.0:1782727304.998540:0:5942:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727304.998569:0:5942:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921c43a23800/0x14a47870ee88cb96 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1752a87bbfbdf065 expref: -99 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727304.998618:0:5942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921c43a23800/0x14a47870ee88cb96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf065 expref: 9 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727304.998632:0:5942:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921c43a23800/0x14a47870ee88cb96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf065 expref: 9 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727304.998644:0:5942:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c43a23800, rc 0) 00000100:00100000:1.0:1782727304.998723:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6e0fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecaf1fda-ff42-4054-9f39-8e142296107b+9:5444:x1869324914525312:12345-192.168.202.60@tcp:101: Request processed in 206us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727304.998731:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 120 00000100:00100000:3.0:1782727305.003935:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1782727305.004078:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914525440 00000100:00100000:0.0:1782727305.004090:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914525440 00000100:00100000:0.0:1782727305.004182:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 121 00000100:00100000:0.0:1782727305.004195:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6e0ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecaf1fda-ff42-4054-9f39-8e142296107b+9:5444:x1869324914525440:12345-192.168.202.60@tcp:256: 20000000:01000000:0.0:1782727305.004232:0:5943:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1782727305.004264:0:5943:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1782727305.004269:0:5943:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1782727305.004273:0:5943:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1782727305.004275:0:5943:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1782727305.013730:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6e0ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecaf1fda-ff42-4054-9f39-8e142296107b+9:5444:x1869324914525440:12345-192.168.202.60@tcp:256: Request processed in 9518us (9839us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727305.013753:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 121 00000100:00100000:2.0:1782727305.032546:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1782727305.032754:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914525568 00000100:00100000:3.0:1782727305.032768:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914525568 00000100:00100000:3.0:1782727305.032978:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 122 00000100:00100000:3.0:1782727305.032991:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6e0ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecaf1fda-ff42-4054-9f39-8e142296107b+9:5444:x1869324914525568:12345-192.168.202.60@tcp:101: 00010000:00010000:3.0:1782727305.033013:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727305.033034:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921c4151c800/0x14a47870ee88cb9d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1752a87bbfbdf06c expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727305.033071:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921c4151c800/0x14a47870ee88cb9d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf06c expref: 10 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727305.033084:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921c4151c800/0x14a47870ee88cb9d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf06c expref: 10 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727305.033095:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c4151c800, rc 0) 00000100:00100000:3.0:1782727305.033278:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6e0ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecaf1fda-ff42-4054-9f39-8e142296107b+10:5444:x1869324914525568:12345-192.168.202.60@tcp:101: Request processed in 289us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727305.033287:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 122 00000100:00100000:2.0:1782727305.046606:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1782727305.046752:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914525696 00000100:00100000:0.0:1782727305.046766:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914525696 00000100:00100000:0.0:1782727305.046834:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 123 00000100:00100000:0.0:1782727305.046844:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6e0fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecaf1fda-ff42-4054-9f39-8e142296107b+10:5444:x1869324914525696:12345-192.168.202.60@tcp:501: 00000100:00100000:0.0:1782727305.047090:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6e0fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecaf1fda-ff42-4054-9f39-8e142296107b+10:5444:x1869324914525696:12345-192.168.202.60@tcp:501: Request processed in 246us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727305.047099:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 123 00000100:00100000:2.0:1782727305.050488:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1782727305.051278:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914525824 00000100:00100000:3.0:1782727305.051294:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914525824 00000100:00100000:3.0:1782727305.051379:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 124 00000100:00100000:3.0:1782727305.051389:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6e0ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecaf1fda-ff42-4054-9f39-8e142296107b+10:5444:x1869324914525824:12345-192.168.202.60@tcp:503: 00000100:00100000:3.0:1782727305.051776:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6e0ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecaf1fda-ff42-4054-9f39-8e142296107b+10:5444:x1869324914525824:12345-192.168.202.60@tcp:503: Request processed in 386us (1304us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727305.051786:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 124 00000100:00100000:2.0:1782727305.066811:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1782727305.071742:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914525952 00000100:00100000:1.0:1782727305.071765:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914525952 00000100:00100000:0.0:1782727305.075943:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 125 00000100:00100000:0.0:1782727305.075963:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6e0fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecaf1fda-ff42-4054-9f39-8e142296107b+10:5466:x1869324914525952:12345-192.168.202.60@tcp:502: 00000100:00100000:0.0:1782727305.076266:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6e0fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecaf1fda-ff42-4054-9f39-8e142296107b+10:5466:x1869324914525952:12345-192.168.202.60@tcp:502: Request processed in 305us (9466us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727305.076275:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 125 00000100:00100000:3.0:1782727305.081711:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1782727305.085147:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914526080 00000100:00100000:2.0:1782727305.088527:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914526080 00000100:00100000:2.0:1782727305.088736:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 126 00000100:00100000:2.0:1782727305.088748:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6e0fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecaf1fda-ff42-4054-9f39-8e142296107b+10:5466:x1869324914526080:12345-192.168.202.60@tcp:502: 00000100:00100000:2.0:1782727305.089004:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6e0fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecaf1fda-ff42-4054-9f39-8e142296107b+10:5466:x1869324914526080:12345-192.168.202.60@tcp:502: Request processed in 257us (7307us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727305.089013:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 126 00000100:00100000:3.0:1782727305.093243:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1782727305.094789:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1782727305.094970:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914526208 00000100:00100000:0.0:1782727305.094982:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914526208 00000100:00100000:0.0:1782727305.095042:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 4 00000100:00100000:0.0:1782727305.095052:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c45e44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2354:x1869324914526208:12345-192.168.202.60@tcp:38: 00010000:00080000:0.0:1782727305.095091:0:5950:0:(ldlm_lib.c:1434:target_handle_connect()) lustre-MDT0000: connection from d85bc959-008e-4782-8f39-df709fbb4636@192.168.202.60@tcp t0 exp 0000000000000000 cur 199 last 0 00000020:00000080:0.0:1782727305.095175:0:5950:0:(genops.c:1406:class_connect()) connect: client d85bc959-008e-4782-8f39-df709fbb4636, cookie 0x14a47870ee88cba4 00000004:00100000:0.0:1782727305.095211:0:5950:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1782727305.095218:0:5950:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:2.0:1782727305.095805:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914526592 00000100:00100000:2.0:1782727305.095812:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914526592 00000100:00100000:2.0:1782727305.095870:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 127 00000100:00100000:2.0:1782727305.095879:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6e0ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecaf1fda-ff42-4054-9f39-8e142296107b+10:2356:x1869324914526592:12345-192.168.202.60@tcp:400: 00000100:00100000:2.0:1782727305.096018:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6e0ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecaf1fda-ff42-4054-9f39-8e142296107b+10:2356:x1869324914526592:12345-192.168.202.60@tcp:400: Request processed in 141us (2791us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727305.096025:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 127 00000100:00080000:0.0:1782727305.106796:0:5950:0:(import.c:65:import_set_state_nolock()) ffff921c7646a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782727305.107380:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c45e44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d85bc959-008e-4782-8f39-df709fbb4636+6:2354:x1869324914526208:12345-192.168.202.60@tcp:38: Request processed in 12324us (12597us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727305.107395:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 4 00010000:00010000:0.0:1782727305.657341:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727305.913615:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7df20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869324939713664:0@lo:13: 00000100:00100000:1.0:1782727305.913716:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727305.919983:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c71e9f0f-6441-4b9b-bc96-153ab9250801:3442:1869324939713792:0@lo:400: 00000100:00100000:3.0:1782727305.920131:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727305.920206:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782727305.920215:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3442:1869324939713920:0@lo:400: 00000100:00100000:3.0:1782727305.920246:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727305.925796:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c76441f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869324939714176:0@lo:13: 00000100:00100000:1.0:1782727305.925934:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727305.925996:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782727305.926004:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7d6e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3445:1869324939714048:0@lo:400: 00000100:00100000:1.0:1782727305.926108:0:6953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939713664 00000100:00100000:1.0:1782727305.926118:0:6953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939713664 00000100:00100000:1.0:1782727305.926198:0:6953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939714176 00000100:00100000:1.0:1782727305.926202:0:6953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939714176 00000100:00100000:1.0:1782727305.926223:0:6953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782727305.926232:0:6953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6e381f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324939713664:12345-0@lo:13: 00002000:00000024:1.0:1782727305.926271:0:6953:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1782727305.926324:0:6953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6e381f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324939713664:12345-0@lo:13: Request processed in 91us (12608us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727305.926332:0:6953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782727305.931151:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782727305.931185:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7d6e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3443:1869324939714304:0@lo:400: 00000100:00100000:1.0:1782727305.931190:0:6953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782727305.931208:0:6953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6e381c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324939714176:12345-0@lo:13: 00002000:00000024:1.0:1782727305.931248:0:6953:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1782727305.931312:0:6953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6e381c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324939714176:12345-0@lo:13: Request processed in 111us (5379us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727305.931321:0:6953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782727305.931327:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939713792 00000100:00100000:2.0:1782727305.931336:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939713792 00000100:00100000:2.0:1782727305.931401:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1782727305.931408:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fe4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:3442:x1869324939713792:12345-0@lo:400: 00000100:00100000:2.0:1782727305.931446:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fe4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:3442:x1869324939713792:12345-0@lo:400: Request processed in 39us (11328us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727305.931485:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:2.0:1782727305.931528:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782727305.931544:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782727305.932819:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727305.932865:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939713920 00000100:00100000:3.0:1782727305.932873:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939713920 00000100:00100000:1.0:1782727305.933075:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939714304 00000100:00100000:1.0:1782727305.933080:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939714304 00000100:00100000:1.0:1782727305.933144:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1782727305.933153:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7df21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1869324939714304:12345-0@lo:400: 00000100:00100000:1.0:1782727305.933219:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7df21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1869324939714304:12345-0@lo:400: Request processed in 68us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727305.933226:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1782727305.933248:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782727305.933259:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727305.933280:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939714048 00000100:00100000:1.0:1782727305.933283:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939714048 00000100:00100000:1.0:1782727305.933302:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1782727305.933321:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6e380700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3445:x1869324939714048:12345-0@lo:400: 00000100:00100000:1.0:1782727305.933364:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6e380700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3445:x1869324939714048:12345-0@lo:400: Request processed in 43us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727305.933369:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1782727305.933382:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1782727305.933411:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c7d6e9880 x1869324939714048/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727305.933425:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7d6e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3445:1869324939714048:0@lo:400: 00010000:00080000:1.0:1782727305.933439:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c76441f80 x1869324939714176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727321 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727305.933454:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c76441f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869324939714176:0@lo:13: 00010000:00080000:1.0:1782727305.933468:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c7df20380 x1869324939713664/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727321 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727305.933476:0:3445:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1782727305.933499:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7df20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869324939713664:0@lo:13: 00000100:00100000:3.0:1782727305.933765:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1782727305.933775:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7df23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1869324939713920:12345-0@lo:400: 00000100:00100000:3.0:1782727305.933811:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7df23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1869324939713920:12345-0@lo:400: Request processed in 39us (13564us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727305.933817:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:3.0:1782727305.933845:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c7d6e9500 x1869324939714304/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727305.933854:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7d6e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3443:1869324939714304:0@lo:400: 00010000:00080000:3.0:1782727305.933880:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c45e41500 x1869324939713920/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727305.934071:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3442:1869324939713920:0@lo:400: 00000100:00100000:3.0:1782727305.934086:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c71e9f0f-6441-4b9b-bc96-153ab9250801:3442:1869324939713792:0@lo:400: 00000100:00100000:3.0:1782727306.118768:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1782727306.118959:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914526464 00000100:00100000:1.0:1782727306.118974:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914526464 00000100:00100000:1.0:1782727306.119233:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 5 00000100:00100000:1.0:1782727306.119246:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7df21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d85bc959-008e-4782-8f39-df709fbb4636+6:5444:x1869324914526464:12345-192.168.202.60@tcp:41: 00000004:00000024:1.0:1782727306.119296:0:5950:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446338560 avail 1300099072 00000100:00100000:1.0:1782727306.119627:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7df21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d85bc959-008e-4782-8f39-df709fbb4636+6:5444:x1869324914526464:12345-192.168.202.60@tcp:41: Request processed in 372us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727306.119643:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 5 00000100:00100000:0.0:1782727306.125717:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1782727306.125899:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1782727306.126317:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914526336 00000100:00100000:3.0:1782727306.126328:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914526336 00000100:00100000:3.0:1782727306.126393:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914526720 00000100:00100000:3.0:1782727306.126397:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914526720 00000100:00100000:3.0:1782727306.126425:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 6 00000100:00100000:3.0:1782727306.126435:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c76440380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d85bc959-008e-4782-8f39-df709fbb4636+7:0:x1869324914526336:12345-192.168.202.60@tcp:41: 00000004:00000024:3.0:1782727306.126478:0:5949:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446338560 avail 1300099072 00000100:00100000:3.0:1782727306.126551:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c76440380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d85bc959-008e-4782-8f39-df709fbb4636+7:0:x1869324914526336:12345-192.168.202.60@tcp:41: Request processed in 116us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727306.126571:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 6 00000100:00100000:3.0:1782727306.126589:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 7 00000100:00100000:3.0:1782727306.126596:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c76443800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d85bc959-008e-4782-8f39-df709fbb4636+6:5444:x1869324914526720:12345-192.168.202.60@tcp:40: 00000100:00100000:3.0:1782727306.126628:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c76443800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d85bc959-008e-4782-8f39-df709fbb4636+6:5444:x1869324914526720:12345-192.168.202.60@tcp:40: Request processed in 32us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727306.126634:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 7 00000100:00080000:2.0:1782727306.127583:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782727306.129613:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1782727306.129659:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1782727306.129698:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1782727306.129740:0:6950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914526848 00000100:00100000:3.0:1782727306.129749:0:6950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914526848 00000100:00100000:3.0:1782727306.129781:0:6950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914526976 00000100:00100000:3.0:1782727306.129783:0:6950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914526976 00000100:00100000:3.0:1782727306.129796:0:6950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 8 00000100:00100000:3.0:1782727306.129803:0:6950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7df20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2354:x1869324914526848:12345-192.168.202.60@tcp:8: 00010000:00080000:3.0:1782727306.129831:0:6950:0:(ldlm_lib.c:1434:target_handle_connect()) lustre-OST0000: connection from d85bc959-008e-4782-8f39-df709fbb4636@192.168.202.60@tcp t0 exp 0000000000000000 cur 200 last 0 00000020:00000080:3.0:1782727306.129862:0:6950:0:(genops.c:1406:class_connect()) connect: client d85bc959-008e-4782-8f39-df709fbb4636, cookie 0x14a47870ee88cbab 00002000:00100000:3.0:1782727306.129874:0:6950:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d85bc959-008e-4782-8f39-df709fbb4636/ffff921c7db03800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1782727306.129908:0:6950:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1782727306.130304:0:6950:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1782727306.130336:0:6950:0:(import.c:65:import_set_state_nolock()) ffff921c7db04000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782727306.130398:0:6950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7df20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d85bc959-008e-4782-8f39-df709fbb4636+6:2354:x1869324914526848:12345-192.168.202.60@tcp:8: Request processed in 594us (848us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727306.130630:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914527104 00000100:00100000:0.0:1782727306.130636:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914527104 00000100:00100000:0.0:1782727306.130670:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 129 00000100:00100000:0.0:1782727306.130678:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fe4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecaf1fda-ff42-4054-9f39-8e142296107b+10:2355:x1869324914527104:12345-192.168.202.60@tcp:400: 00000100:00100000:0.0:1782727306.130725:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fe4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecaf1fda-ff42-4054-9f39-8e142296107b+10:2355:x1869324914527104:12345-192.168.202.60@tcp:400: Request processed in 47us (1025us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727306.130732:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 129 00000100:00100000:3.0:1782727306.130813:0:6950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 8 00000100:00100000:3.0:1782727306.130829:0:6950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 9 00000100:00100000:3.0:1782727306.130834:0:6950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7df23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2354:x1869324914526976:12345-192.168.202.60@tcp:8: 00010000:00080000:3.0:1782727306.130853:0:6950:0:(ldlm_lib.c:1434:target_handle_connect()) lustre-OST0001: connection from d85bc959-008e-4782-8f39-df709fbb4636@192.168.202.60@tcp t0 exp 0000000000000000 cur 200 last 0 00000020:00000080:3.0:1782727306.130871:0:6950:0:(genops.c:1406:class_connect()) connect: client d85bc959-008e-4782-8f39-df709fbb4636, cookie 0x14a47870ee88cbb2 00002000:00100000:3.0:1782727306.130878:0:6950:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d85bc959-008e-4782-8f39-df709fbb4636/ffff921c7db01000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1782727306.130909:0:6950:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1782727306.131033:0:6950:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1782727306.131060:0:6950:0:(import.c:65:import_set_state_nolock()) ffff921c6dd22000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782727306.131086:0:6950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7df23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d85bc959-008e-4782-8f39-df709fbb4636+6:2354:x1869324914526976:12345-192.168.202.60@tcp:8: Request processed in 250us (1426us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727306.131092:0:6950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 9 00000100:00100000:3.0:1782727306.136046:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1782727306.136497:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914527232 00000100:00100000:1.0:1782727306.136508:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914527232 00000100:00100000:1.0:1782727306.136689:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 0 00000100:00100000:1.0:1782727306.136701:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7df20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d85bc959-008e-4782-8f39-df709fbb4636+6:5444:x1869324914527232:12345-192.168.202.60@tcp:33: 00000004:00080000:1.0:1782727306.154995:0:5951:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 18204us 00000004:00200000:1.0:1782727306.185318:0:5951:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1782727306.185437:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7df20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d85bc959-008e-4782-8f39-df709fbb4636+6:5444:x1869324914527232:12345-192.168.202.60@tcp:33: Request processed in 48733us (49395us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727306.185448:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 0 00000100:00100000:2.0:1782727306.488477:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1782727306.488803:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914527360 00000100:00100000:3.0:1782727306.489149:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914527360 00000100:00100000:3.0:1782727306.489222:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 8 00000100:00100000:3.0:1782727306.489233:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7d6ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d85bc959-008e-4782-8f39-df709fbb4636+6:5483:x1869324914527360:12345-192.168.202.60@tcp:101: 00010000:00010000:3.0:1782727306.489255:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727306.489340:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151d800/0x14a47870ee88cbb9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1752a87bbfbdf096 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727306.490016:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151c600/0x14a47870ee88cbc0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727306.490033:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151c600/0x14a47870ee88cbc0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727306.490135:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151c600/0x14a47870ee88cbc0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782727306.490188:0:5949:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1782727306.490191:0:5949:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782727306.490208:0:5949:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151c600/0x14a47870ee88cbc0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727306.490234:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151d800/0x14a47870ee88cbb9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf096 expref: 8 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727306.490253:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151c600/0x14a47870ee88cbc0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf096 expref: 7 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727306.490261:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921c5fdb6500) 00010000:00010000:3.0:1782727306.490264:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782727306.490267:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c4151c600, rc 0) 00000100:00100000:3.0:1782727306.490351:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7d6ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d85bc959-008e-4782-8f39-df709fbb4636+7:5483:x1869324914527360:12345-192.168.202.60@tcp:101: Request processed in 1119us (1882us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727306.490360:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 8 00010000:00010000:3.0:1782727306.683702:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727307.708944:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727308.730381:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727308.733150:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1782727308.733284:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914527488 00000100:00100000:1.0:1782727308.733297:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914527488 00000100:00100000:1.0:1782727308.733400:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 9 00000100:00100000:1.0:1782727308.733412:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c76442a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d85bc959-008e-4782-8f39-df709fbb4636+7:5535:x1869324914527488:12345-192.168.202.60@tcp:41: 00000004:00000024:1.0:1782727308.733475:0:5948:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446338560 avail 1300099072 00000100:00100000:1.0:1782727308.733579:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c76442a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d85bc959-008e-4782-8f39-df709fbb4636+7:5535:x1869324914527488:12345-192.168.202.60@tcp:41: Request processed in 168us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727308.733588:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 9 00000100:00080000:2.0:1782727308.734004:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782727308.737940:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1782727308.738053:0:6952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914527616 00000100:00100000:2.0:1782727308.738067:0:6952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914527616 00000100:00100000:2.0:1782727308.738186:0:6952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 8 00000100:00100000:2.0:1782727308.738201:0:6952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c76442300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d85bc959-008e-4782-8f39-df709fbb4636+6:5535:x1869324914527616:12345-192.168.202.60@tcp:13: 00002000:00000024:2.0:1782727308.738249:0:6952:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1782727308.738336:0:6952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c76442300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d85bc959-008e-4782-8f39-df709fbb4636+6:5535:x1869324914527616:12345-192.168.202.60@tcp:13: Request processed in 139us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727308.738345:0:6952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 8 00000100:00080000:1.0:1782727308.738865:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782727308.742235:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1782727308.742418:0:6952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914527744 00000100:00100000:2.0:1782727308.742431:0:6952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914527744 00000100:00100000:2.0:1782727308.742525:0:6952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 9 00000100:00100000:2.0:1782727308.742538:0:6952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7df21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d85bc959-008e-4782-8f39-df709fbb4636+6:5535:x1869324914527744:12345-192.168.202.60@tcp:13: 00002000:00000024:2.0:1782727308.742578:0:6952:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1782727308.742672:0:6952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7df21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d85bc959-008e-4782-8f39-df709fbb4636+6:5535:x1869324914527744:12345-192.168.202.60@tcp:13: Request processed in 135us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727308.742680:0:6952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 9 00000100:00080000:1.0:1782727308.743068:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1782727309.754648:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1782727310.011275:0:8019:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d85bc959-008e-4782-8f39-df709fbb4636 00010000:00010000:3.0:1782727310.777053:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727311.033327:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7df23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869324939714816:0@lo:400: 00000100:00100000:3.0:1782727311.033398:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727311.033464:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1782727311.033471:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7df21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c71e9f0f-6441-4b9b-bc96-153ab9250801:3442:1869324939714432:0@lo:400: 00000100:00100000:3.0:1782727311.033501:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727311.033535:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7df22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3442:1869324939714944:0@lo:400: 00000100:00100000:3.0:1782727311.033560:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727311.033586:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7df22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869324939714560:0@lo:400: 00000100:00100000:3.0:1782727311.033609:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727311.033624:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7df20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869324939715072:0@lo:400: 00000100:00100000:3.0:1782727311.033644:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727311.033661:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782727311.033667:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7df21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3444:1869324939714688:0@lo:400: 00000100:00100000:3.0:1782727311.033686:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727311.033713:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939714944 00000100:00100000:3.0:1782727311.033721:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939714944 00000100:00100000:3.0:1782727311.033765:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939714560 00000100:00100000:3.0:1782727311.033769:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939714560 00000100:00100000:3.0:1782727311.033780:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939714688 00000100:00100000:3.0:1782727311.033782:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939714688 00000100:00100000:3.0:1782727311.033798:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1782727311.033806:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7df23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1869324939714944:12345-0@lo:400: 00000100:00100000:3.0:1782727311.033859:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7df23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1869324939714944:12345-0@lo:400: Request processed in 53us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727311.033866:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1782727311.033915:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1782727311.033922:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7df22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869324939714560:12345-0@lo:400: 00000100:00100000:3.0:1782727311.033954:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7df22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869324939714560:12345-0@lo:400: Request processed in 32us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727311.033970:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1782727311.033983:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1782727311.033989:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7df20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869324939714688:12345-0@lo:400: 00000100:00100000:3.0:1782727311.034020:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7df20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869324939714688:12345-0@lo:400: Request processed in 32us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727311.034025:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1782727311.034042:0:6950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939714816 00000100:00100000:3.0:1782727311.034045:0:6950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939714816 00000100:00100000:3.0:1782727311.034071:0:6950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939715072 00000100:00100000:3.0:1782727311.034073:0:6950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939715072 00000100:00100000:3.0:1782727311.034101:0:6950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782727311.034116:0:6950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7df20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3442:x1869324939714816:12345-0@lo:400: 00000100:00100000:3.0:1782727311.034147:0:6950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7df20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3442:x1869324939714816:12345-0@lo:400: Request processed in 40us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727311.034152:0:6950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782727311.034161:0:6950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1782727311.034167:0:6950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7df22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324939715072:12345-0@lo:400: 00000100:00100000:3.0:1782727311.034190:0:6950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7df22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324939715072:12345-0@lo:400: Request processed in 23us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727311.034195:0:6950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1782727311.034251:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7df21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3444:1869324939714688:0@lo:400: 00000100:00100000:3.0:1782727311.034262:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7df22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869324939714560:0@lo:400: 00010000:00080000:3.0:1782727311.034273:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c7df20a80 x1869324939715072/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727311.034282:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7df20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869324939715072:0@lo:400: 00000100:00100000:3.0:1782727311.034325:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7df22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3442:1869324939714944:0@lo:400: 00010000:00080000:3.0:1782727311.034336:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c7df23b80 x1869324939714816/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727311.034345:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7df23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869324939714816:0@lo:400: 00000100:00100000:1.0:1782727311.035244:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939714432 00000100:00100000:1.0:1782727311.035251:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939714432 00000100:00100000:1.0:1782727311.035287:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1782727311.035294:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fdb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:3442:x1869324939714432:12345-0@lo:400: 00000100:00100000:1.0:1782727311.035349:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fdb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:3442:x1869324939714432:12345-0@lo:400: Request processed in 56us (1846us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727311.035355:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:1.0:1782727311.035391:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782727311.035395:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782727311.035397:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782727311.035437:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7df21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c71e9f0f-6441-4b9b-bc96-153ab9250801:3442:1869324939714432:0@lo:400: 00000100:00100000:2.0:1782727311.035628:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7d6e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869324939715200:0@lo:13: 00000100:00100000:2.0:1782727311.035664:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727311.035697:0:6952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939715200 00000100:00100000:2.0:1782727311.035701:0:6952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939715200 00000100:00100000:2.0:1782727311.035736:0:6952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1782727311.035742:0:6952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7d6ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324939715200:12345-0@lo:13: 00002000:00000024:2.0:1782727311.035763:0:6952:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1782727311.035799:0:6952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7d6ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324939715200:12345-0@lo:13: Request processed in 57us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727311.035805:0:6952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1782727311.035834:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c7d6e9180 x1869324939715200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727327 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727311.035849:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7d6e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869324939715200:0@lo:13: 00000100:00100000:1.0:1782727311.036716:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7df23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869324939715328:0@lo:13: 00000100:00100000:1.0:1782727311.036754:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727311.036834:0:6952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939715328 00000100:00100000:3.0:1782727311.036840:0:6952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939715328 00000100:00100000:3.0:1782727311.036875:0:6952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1782727311.036909:0:6952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6e381500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1869324939715328:12345-0@lo:13: 00002000:00000024:3.0:1782727311.036931:0:6952:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1782727311.036982:0:6952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6e381500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1869324939715328:12345-0@lo:13: Request processed in 100us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727311.036988:0:6952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1782727311.037712:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c7df23b80 x1869324939715328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727327 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727311.037730:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7df23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869324939715328:0@lo:13: 00000001:00100000:3.0:1782727311.041303:0:5929:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d85bc959-008e-4782-8f39-df709fbb4636 00000100:00100000:0.0:1782727311.380911:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1782727311.380962:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1782727311.380995:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1782727311.381036:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1782727311.381062:0:6950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914528128 00000100:00100000:0.0:1782727311.381071:0:6950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914528128 00000100:00100000:0.0:1782727311.381136:0:6950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914528256 00000100:00100000:0.0:1782727311.381139:0:6950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914528256 00000100:00100000:0.0:1782727311.381158:0:6950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 5 00000100:00100000:0.0:1782727311.381166:0:6950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c76442680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d85bc959-008e-4782-8f39-df709fbb4636+6:2358:x1869324914528128:12345-192.168.202.60@tcp:400: 00000100:00100000:0.0:1782727311.381239:0:6950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c76442680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d85bc959-008e-4782-8f39-df709fbb4636+6:2358:x1869324914528128:12345-192.168.202.60@tcp:400: Request processed in 72us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727311.381247:0:6950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 5 00000100:00100000:0.0:1782727311.381266:0:6950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 6 00000100:00100000:0.0:1782727311.381273:0:6950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c76443b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d85bc959-008e-4782-8f39-df709fbb4636+5:2358:x1869324914528256:12345-192.168.202.60@tcp:400: 00000100:00100000:0.0:1782727311.381297:0:6950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c76443b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d85bc959-008e-4782-8f39-df709fbb4636+5:2358:x1869324914528256:12345-192.168.202.60@tcp:400: Request processed in 25us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727311.381316:0:6950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 6 00000100:00100000:3.0:1782727311.381751:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914528000 00000100:00100000:3.0:1782727311.381755:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914528000 00000100:00100000:3.0:1782727311.381798:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 26 00000100:00100000:3.0:1782727311.381806:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c76441f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d85bc959-008e-4782-8f39-df709fbb4636+6:2358:x1869324914528000:12345-192.168.202.60@tcp:400: 00000100:00100000:3.0:1782727311.381844:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c76441f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d85bc959-008e-4782-8f39-df709fbb4636+6:2358:x1869324914528000:12345-192.168.202.60@tcp:400: Request processed in 39us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727311.381850:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 26 00000100:00100000:1.0:1782727311.384570:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914527872 00000100:00100000:1.0:1782727311.384584:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914527872 00000100:00100000:1.0:1782727311.384638:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 131 00000100:00100000:1.0:1782727311.384647:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fdb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecaf1fda-ff42-4054-9f39-8e142296107b+10:2358:x1869324914527872:12345-192.168.202.60@tcp:400: 00000100:00100000:1.0:1782727311.384717:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fdb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecaf1fda-ff42-4054-9f39-8e142296107b+10:2358:x1869324914527872:12345-192.168.202.60@tcp:400: Request processed in 71us (3835us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727311.384726:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 131 00000100:00080000:1.0:1782727311.384762:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782727311.384767:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782727311.384770:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:3.0:1782727311.536578:0:8683:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1782727311.801548:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1782727312.060576:0:6943:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d85bc959-008e-4782-8f39-df709fbb4636 00010000:00010000:1.0:1782727312.825981:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727313.854376:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727314.875184:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782727315.754013:0:8830:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffed6ccb660 20000000:00000080:3.0:1782727315.754032:0:8830:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff921c7deb3000 uarg=0000000000000000 20000000:01000000:3.0:1782727315.754174:0:8830:0:(mgs_llog.c:2004:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1782727315.754177:0:8830:0:(mgs_llog.c:6054:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1782727315.754184:0:8830:0:(mgs_llog.c:6085:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1782727315.754189:0:8830:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1782727315.754194:0:8830:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1782727315.754251:0:8830:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1782727315.754254:0:8830:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1782727315.755062:0:8831:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:3.0:1782727315.755587:0:8830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:3.0:1782727315.755633:0:8830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:3.0:1782727315.755652:0:8830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:3.0:1782727315.755664:0:8830:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1782727315.755667:0:8830:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1782727315.756279:0:8832:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1782727315.756614:0:8830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1782727315.756635:0:8830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1782727315.756649:0:8830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:3.0:1782727315.756657:0:8830:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1782727315.756659:0:8830:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1782727315.757201:0:8833:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:1.0:1782727315.757567:0:8830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:1.0:1782727315.757592:0:8830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:1.0:1782727315.757608:0:8830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:1.0:1782727315.757618:0:8830:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1782727315.757621:0:8830:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1782727315.758458:0:8834:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1782727315.758855:0:8830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1782727315.758879:0:8830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:1.0:1782727315.759218:0:8830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 10000000:01000000:1.0:1782727315.759244:0:8830:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1782727315.759394:0:8830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff921c43a22000/0x14a47870ee88cbc7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727315.759413:0:8830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff921c43a23400/0x14a47870ee88cac4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x14a47870ee88cabd expref: 18 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727315.759420:0:8830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff921c4151d000/0x14a47870ee88caee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x14a47870ee88cae7 expref: 18 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727315.759426:0:8830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff921c429d5e00/0x14a47870ee88cb18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x14a47870ee88cb11 expref: 18 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727315.759432:0:8830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff921c7a3e0e00/0x14a47870ee88cb26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x14a47870ee88cb1f expref: 18 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727315.759438:0:8830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff921c43a22800/0x14a47870ee88cb34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x14a47870ee88cb2d expref: 18 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727315.759444:0:8830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff921c43a22400/0x14a47870ee88cb50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x14a47870ee88cb49 expref: 18 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727315.759451:0:8830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff921c429d5600/0x14a47870ee88cb7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x14a47870ee88cb73 expref: 18 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727315.759460:0:8830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff921c7a3e1a00/0x14a47870ee88cb88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf034 expref: 9 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727315.759466:0:8830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff921c429d5a00/0x14a47870ee88cb8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf03b expref: 9 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727315.759548:0:8830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff921c43a22000/0x14a47870ee88cbc7 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727315.759592:0:8830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff921c429d5a00/0x14a47870ee88cb8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf03b expref: 9 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727315.759608:0:8830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff921c429d5a00/0x14a47870ee88cb8f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf03b expref: 9 pid: 5943 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727315.759623:0:8830:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c6e380000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8830:1869324939715456:192.168.202.60@tcp:104: 00010000:00010000:1.0:1782727315.759790:0:8830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff921c7a3e1a00/0x14a47870ee88cb88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf034 expref: 9 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727315.759799:0:8830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff921c7a3e1a00/0x14a47870ee88cb88 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf034 expref: 9 pid: 5944 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727315.759808:0:8830:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c6e380a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8830:1869324939715584:192.168.202.60@tcp:104: 00010000:00010000:1.0:1782727315.759842:0:8830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff921c429d5600/0x14a47870ee88cb7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x14a47870ee88cb73 expref: 18 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727315.759850:0:8830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff921c429d5600/0x14a47870ee88cb7a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x14a47870ee88cb73 expref: 18 pid: 5944 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727315.759859:0:8830:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c6e381180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8830:1869324939715712:0@lo:104: 00000100:00100000:1.0:1782727315.759974:0:8830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782727315.760056:0:8830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff921c43a22400/0x14a47870ee88cb50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x14a47870ee88cb49 expref: 18 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727315.760073:0:8830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff921c43a22400/0x14a47870ee88cb50 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x14a47870ee88cb49 expref: 18 pid: 5943 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727315.760094:0:8830:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c6e383100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8830:1869324939715840:0@lo:104: 00000100:00100000:1.0:1782727315.760120:0:8830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727315.765849:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1782727315.766081:0:5935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914528384 00000100:00100000:2.0:1782727315.766090:0:5935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914528384 00010000:00010000:2.0:1782727315.766127:0:5935:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff921c429d5a00/0x14a47870ee88cb8f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf03b expref: 10 pid: 5943 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727315.766171:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 12 00000100:00100000:2.0:1782727315.766181:0:5935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c76441500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ecaf1fda-ff42-4054-9f39-8e142296107b+10:2357:x1869324914528384:12345-192.168.202.60@tcp:103: 00010000:00010000:2.0:1782727315.766195:0:5935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782727315.766200:0:5935:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff921c429d5a00/0x14a47870ee88cb8f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf03b expref: 10 pid: 5943 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727315.766211:0:5935:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff921c429d5a00/0x14a47870ee88cb8f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf03b expref: 10 pid: 5943 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727315.766229:0:5935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782727315.766292:0:5935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c76441500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ecaf1fda-ff42-4054-9f39-8e142296107b+10:2357:x1869324914528384:12345-192.168.202.60@tcp:103: Request processed in 111us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727315.766300:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 12 00010000:00010000:1.0:1782727315.766743:0:8830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff921c43a22800/0x14a47870ee88cb34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x14a47870ee88cb2d expref: 18 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727315.766756:0:8830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff921c43a22800/0x14a47870ee88cb34 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x14a47870ee88cb2d expref: 18 pid: 5943 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727315.766769:0:8830:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e45180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8830:1869324939715968:0@lo:104: 00010000:00010000:1.0:1782727315.766828:0:8830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff921c7a3e0e00/0x14a47870ee88cb26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x14a47870ee88cb1f expref: 18 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727315.766836:0:8830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff921c7a3e0e00/0x14a47870ee88cb26 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x14a47870ee88cb1f expref: 18 pid: 5944 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727315.766845:0:8830:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7dfc2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8830:1869324939716096:0@lo:104: 00010000:00010000:1.0:1782727315.766874:0:8830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff921c429d5e00/0x14a47870ee88cb18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x14a47870ee88cb11 expref: 18 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727315.766903:0:8830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff921c429d5e00/0x14a47870ee88cb18 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x14a47870ee88cb11 expref: 18 pid: 5943 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727315.766912:0:8830:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7dfc0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8830:1869324939716224:0@lo:104: 00010000:00010000:1.0:1782727315.766937:0:8830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff921c4151d000/0x14a47870ee88caee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x14a47870ee88cae7 expref: 18 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727315.766945:0:8830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff921c4151d000/0x14a47870ee88caee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x14a47870ee88cae7 expref: 18 pid: 5944 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727315.766965:0:8830:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7dfc3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8830:1869324939716352:0@lo:104: 00010000:00010000:1.0:1782727315.766992:0:8830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff921c43a23400/0x14a47870ee88cac4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x14a47870ee88cabd expref: 18 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727315.767000:0:8830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff921c43a23400/0x14a47870ee88cac4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x14a47870ee88cabd expref: 18 pid: 5943 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727315.767008:0:8830:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7dfc1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8830:1869324939716480:0@lo:104: 00000100:00100000:1.0:1782727315.767024:0:8830:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c5152f000 going to sleep for 11 seconds 00010000:00010000:1.0:1782727315.767059:0:8830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921c429d5a00/0x14a47870ee88cb8f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf03b expref: 9 pid: 5943 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727315.767073:0:8830:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c6e380000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8830:1869324939715456:192.168.202.60@tcp:104: 00000100:00100000:1.0:1782727315.767085:0:8830:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c6e380a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8830:1869324939715584:192.168.202.60@tcp:104: 00000100:00100000:3.0:1782727315.770188:0:5933:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1782727315.770233:0:5933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727315.770256:0:5933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727315.770279:0:5933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727315.770289:0:5933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727315.770299:0:5933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727315.770318:0:5933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939715712 00000100:00100000:3.0:1782727315.770326:0:5933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939715712 00000100:00100000:3.0:1782727315.770367:0:5933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939715840 00000100:00100000:3.0:1782727315.770370:0:5933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939715840 00000100:00100000:3.0:1782727315.770381:0:5933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939715968 00000100:00100000:3.0:1782727315.770383:0:5933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939715968 00000100:00100000:3.0:1782727315.770391:0:5933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939716096 00000100:00100000:3.0:1782727315.770393:0:5933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939716096 00000100:00100000:3.0:1782727315.770401:0:5933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939716224 00000100:00100000:3.0:1782727315.770403:0:5933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939716224 00000100:00100000:3.0:1782727315.770430:0:5933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939716352 00000100:00100000:3.0:1782727315.770433:0:5933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939716352 00000100:00100000:3.0:1782727315.770440:0:5933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939716480 00000100:00100000:3.0:1782727315.770442:0:5933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939716480 00000100:00100000:3.0:1782727315.770454:0:5933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1782727315.770462:0:5933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6e382d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c71e9f0f-6441-4b9b-bc96-153ab9250801+9:8830:x1869324939715712:12345-0@lo:104: 00010000:00010000:3.0:1782727315.770492:0:5933:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.160@tcp lock: ffff921c43a22600/0x14a47870ee88cb73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x14a47870ee88cb7a expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727315.770566:0:5933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782727315.770572:0:5933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6e382d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c71e9f0f-6441-4b9b-bc96-153ab9250801+9:8830:x1869324939715712:12345-0@lo:104: Request processed in 111us (10600us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727315.770579:0:5933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1782727315.770596:0:5933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1782727315.770602:0:5933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7d6a6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c71e9f0f-6441-4b9b-bc96-153ab9250801+8:8830:x1869324939715840:12345-0@lo:104: 00010000:00010000:3.0:1782727315.770610:0:5933:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.160@tcp lock: ffff921c429d4600/0x14a47870ee88cb49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x14a47870ee88cb50 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727315.770643:0:5933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1782727315.770648:0:5933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7d6a6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c71e9f0f-6441-4b9b-bc96-153ab9250801+8:8830:x1869324939715840:12345-0@lo:104: Request processed in 47us (10528us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727315.770654:0:5933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1782727315.770689:0:5933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1782727315.770695:0:5933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7df22300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c71e9f0f-6441-4b9b-bc96-153ab9250801+7:8830:x1869324939715968:12345-0@lo:104: 00010000:00010000:3.0:1782727315.770702:0:5933:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.160@tcp lock: ffff921c429d4a00/0x14a47870ee88cb2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x14a47870ee88cb34 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727315.770735:0:5933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1782727315.770746:0:5933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7df22300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c71e9f0f-6441-4b9b-bc96-153ab9250801+7:8830:x1869324939715968:12345-0@lo:104: Request processed in 51us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727315.770752:0:5933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1782727315.770764:0:5933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1782727315.770770:0:5933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7df20a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c71e9f0f-6441-4b9b-bc96-153ab9250801+6:8830:x1869324939716096:12345-0@lo:104: 00010000:00010000:3.0:1782727315.770777:0:5933:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.160@tcp lock: ffff921c7a3e0a00/0x14a47870ee88cb1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x14a47870ee88cb26 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727315.770805:0:5933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1782727315.770810:0:5933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7df20a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c71e9f0f-6441-4b9b-bc96-153ab9250801+6:8830:x1869324939716096:12345-0@lo:104: Request processed in 41us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727315.770815:0:5933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1782727315.770827:0:5933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1782727315.770833:0:5933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7df22680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c71e9f0f-6441-4b9b-bc96-153ab9250801+5:8830:x1869324939716224:12345-0@lo:104: 00010000:00010000:3.0:1782727315.770840:0:5933:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.160@tcp lock: ffff921c43a22e00/0x14a47870ee88cb11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x14a47870ee88cb18 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727315.770864:0:5933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1782727315.770868:0:5933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7df22680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c71e9f0f-6441-4b9b-bc96-153ab9250801+5:8830:x1869324939716224:12345-0@lo:104: Request processed in 36us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727315.770873:0:5933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1782727315.771070:0:5933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1782727315.771079:0:5933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7df21180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c71e9f0f-6441-4b9b-bc96-153ab9250801+4:8830:x1869324939716352:12345-0@lo:104: 00010000:00010000:3.0:1782727315.771086:0:5933:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.160@tcp lock: ffff921c43a22c00/0x14a47870ee88cae7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x14a47870ee88caee expref: -99 pid: 8017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727315.771115:0:5933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:3.0:1782727315.771126:0:5933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7df21180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c71e9f0f-6441-4b9b-bc96-153ab9250801+4:8830:x1869324939716352:12345-0@lo:104: Request processed in 49us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727315.771131:0:5933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1782727315.771142:0:5933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1782727315.771148:0:5933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7df23b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c71e9f0f-6441-4b9b-bc96-153ab9250801+3:8830:x1869324939716480:12345-0@lo:104: 00010000:00010000:3.0:1782727315.771155:0:5933:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.160@tcp lock: ffff921c4151c400/0x14a47870ee88cabd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x14a47870ee88cac4 expref: -99 pid: 8017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727315.771182:0:5933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:3.0:1782727315.771187:0:5933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7df23b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c71e9f0f-6441-4b9b-bc96-153ab9250801+3:8830:x1869324939716480:12345-0@lo:104: Request processed in 40us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727315.771191:0:5933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1782727315.771253:0:5938:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1782727315.771259:0:5938:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff921c43a22600/0x14a47870ee88cb73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x14a47870ee88cb7a expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727315.771265:0:5938:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c43a22600 already unused, calling callback (ffffffffc12b0c20) 10000000:00010000:3.0:1782727315.771269:0:5938:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff921c43a22600/0x14a47870ee88cb73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x14a47870ee88cb7a expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727315.771276:0:5938:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff921c43a22600/0x14a47870ee88cb73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x14a47870ee88cb7a expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782727315.771282:0:5938:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff921c43a22600/0x14a47870ee88cb73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x14a47870ee88cb7a expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727315.771287:0:5938:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782727315.771323:0:5938:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff921c43a22600/0x14a47870ee88cb73 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x14a47870ee88cb7a expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727315.771340:0:5938:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782727315.771361:0:5938:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff921c43a22600/0x14a47870ee88cb73 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x14a47870ee88cb7a expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727315.771368:0:5938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff921c43a22600/0x14a47870ee88cb73 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x14a47870ee88cb7a expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727315.771383:0:5938:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1782727315.771386:0:5938:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff921c429d4600/0x14a47870ee88cb49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x14a47870ee88cb50 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727315.771392:0:5938:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c429d4600 already unused, calling callback (ffffffffc12b0c20) 10000000:00010000:3.0:1782727315.771395:0:5938:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff921c429d4600/0x14a47870ee88cb49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x14a47870ee88cb50 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727315.771402:0:5938:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff921c429d4600/0x14a47870ee88cb49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x14a47870ee88cb50 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782727315.771408:0:5938:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff921c429d4600/0x14a47870ee88cb49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x14a47870ee88cb50 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727315.771412:0:5938:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782727315.771424:0:5938:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff921c429d4600/0x14a47870ee88cb49 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x14a47870ee88cb50 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727315.771429:0:5938:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782727315.771442:0:5938:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff921c429d4600/0x14a47870ee88cb49 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x14a47870ee88cb50 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727315.771447:0:5938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff921c429d4600/0x14a47870ee88cb49 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x14a47870ee88cb50 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727315.771463:0:5938:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1782727315.771465:0:5938:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff921c429d4a00/0x14a47870ee88cb2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x14a47870ee88cb34 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727315.771740:0:5938:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c429d4a00 already unused, calling callback (ffffffffc12b0c20) 10000000:00010000:3.0:1782727315.771743:0:5938:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff921c429d4a00/0x14a47870ee88cb2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x14a47870ee88cb34 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727315.771749:0:5938:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff921c429d4a00/0x14a47870ee88cb2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x14a47870ee88cb34 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782727315.771756:0:5938:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff921c429d4a00/0x14a47870ee88cb2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x14a47870ee88cb34 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727315.771761:0:5938:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782727315.771778:0:5938:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff921c429d4a00/0x14a47870ee88cb2d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x14a47870ee88cb34 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727315.771783:0:5938:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782727315.771788:0:5938:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff921c429d4a00/0x14a47870ee88cb2d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x14a47870ee88cb34 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727315.771794:0:5938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff921c429d4a00/0x14a47870ee88cb2d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x14a47870ee88cb34 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727315.771804:0:5938:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1782727315.771807:0:5938:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff921c7a3e0a00/0x14a47870ee88cb1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x14a47870ee88cb26 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727315.771821:0:5938:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c7a3e0a00 already unused, calling callback (ffffffffc12b0c20) 10000000:00010000:3.0:1782727315.771824:0:5938:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff921c7a3e0a00/0x14a47870ee88cb1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x14a47870ee88cb26 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727315.771830:0:5938:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff921c7a3e0a00/0x14a47870ee88cb1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x14a47870ee88cb26 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782727315.771836:0:5938:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff921c7a3e0a00/0x14a47870ee88cb1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x14a47870ee88cb26 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727315.771841:0:5938:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782727315.771855:0:5938:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff921c7a3e0a00/0x14a47870ee88cb1f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x14a47870ee88cb26 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727315.771860:0:5938:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782727315.771865:0:5938:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff921c7a3e0a00/0x14a47870ee88cb1f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x14a47870ee88cb26 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727315.771871:0:5938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff921c7a3e0a00/0x14a47870ee88cb1f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x14a47870ee88cb26 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727315.771880:0:5938:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1782727315.772144:0:5938:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff921c43a22e00/0x14a47870ee88cb11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x14a47870ee88cb18 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727315.772151:0:5938:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c43a22e00 already unused, calling callback (ffffffffc12b0c20) 10000000:00010000:3.0:1782727315.772153:0:5938:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff921c43a22e00/0x14a47870ee88cb11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x14a47870ee88cb18 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727315.772170:0:5938:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff921c43a22e00/0x14a47870ee88cb11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x14a47870ee88cb18 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782727315.772176:0:5938:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff921c43a22e00/0x14a47870ee88cb11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x14a47870ee88cb18 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727315.772181:0:5938:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782727315.772196:0:5938:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff921c43a22e00/0x14a47870ee88cb11 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x14a47870ee88cb18 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727315.772201:0:5938:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782727315.772206:0:5938:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff921c43a22e00/0x14a47870ee88cb11 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x14a47870ee88cb18 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727315.772211:0:5938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff921c43a22e00/0x14a47870ee88cb11 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x14a47870ee88cb18 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727315.772220:0:5938:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782727315.772223:0:5938:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff921c43a22c00/0x14a47870ee88cae7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x14a47870ee88caee expref: -99 pid: 8017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727315.772227:0:5938:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c43a22c00 already unused, calling callback (ffffffffc12b0c20) 10000000:00010000:3.0:1782727315.772230:0:5938:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff921c43a22c00/0x14a47870ee88cae7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x14a47870ee88caee expref: -99 pid: 8017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727315.772235:0:5938:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff921c43a22c00/0x14a47870ee88cae7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x14a47870ee88caee expref: -99 pid: 8017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782727315.772240:0:5938:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff921c43a22c00/0x14a47870ee88cae7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x14a47870ee88caee expref: -99 pid: 8017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727315.772249:0:5938:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782727315.772368:0:5938:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff921c43a22c00/0x14a47870ee88cae7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x14a47870ee88caee expref: -99 pid: 8017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727315.772375:0:5938:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782727315.772381:0:5938:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff921c43a22c00/0x14a47870ee88cae7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x14a47870ee88caee expref: -99 pid: 8017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727315.772386:0:5938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff921c43a22c00/0x14a47870ee88cae7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x14a47870ee88caee expref: -99 pid: 8017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727315.772394:0:5938:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782727315.772397:0:5938:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff921c4151c400/0x14a47870ee88cabd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x14a47870ee88cac4 expref: -99 pid: 8017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727315.772401:0:5938:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c4151c400 already unused, calling callback (ffffffffc12b0c20) 10000000:00010000:3.0:1782727315.772404:0:5938:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff921c4151c400/0x14a47870ee88cabd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x14a47870ee88cac4 expref: -99 pid: 8017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727315.772410:0:5938:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff921c4151c400/0x14a47870ee88cabd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x14a47870ee88cac4 expref: -99 pid: 8017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782727315.772414:0:5938:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff921c4151c400/0x14a47870ee88cabd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x14a47870ee88cac4 expref: -99 pid: 8017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727315.772419:0:5938:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782727315.772431:0:5938:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff921c4151c400/0x14a47870ee88cabd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x14a47870ee88cac4 expref: -99 pid: 8017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727315.772436:0:5938:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782727315.772446:0:5938:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff921c4151c400/0x14a47870ee88cabd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x14a47870ee88cac4 expref: -99 pid: 8017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727315.772451:0:5938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff921c4151c400/0x14a47870ee88cabd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x14a47870ee88cac4 expref: -99 pid: 8017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727315.772463:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727315.772464:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727315.772466:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727315.772552:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727315.772558:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727315.772574:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c71e9f0f-6441-4b9b-bc96-153ab9250801:3442:1869324939716992:0@lo:103: 00000100:00100000:3.0:1782727315.772623:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727315.772669:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1782727315.772676:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7df21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c71e9f0f-6441-4b9b-bc96-153ab9250801:3442:1869324939716608:0@lo:103: 00000100:00100000:3.0:1782727315.772713:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727315.772732:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c71e9f0f-6441-4b9b-bc96-153ab9250801:3442:1869324939717120:0@lo:103: 00000100:00100000:3.0:1782727315.772752:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727315.772781:0:5936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939716992 00000100:00100000:3.0:1782727315.772788:0:5936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939716992 00010000:00010000:3.0:1782727315.772811:0:5936:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff921c7a3e0e00/0x14a47870ee88cb26 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x14a47870ee88cb1f expref: 19 pid: 5944 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727315.772827:0:5936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939716608 00000100:00100000:3.0:1782727315.772830:0:5936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939716608 00010000:00010000:3.0:1782727315.772839:0:5936:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff921c429d5600/0x14a47870ee88cb7a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x14a47870ee88cb73 expref: 20 pid: 5944 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727315.772847:0:5936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939717120 00000100:00100000:3.0:1782727315.772850:0:5936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939717120 00010000:00010000:3.0:1782727315.772875:0:5936:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff921c429d5e00/0x14a47870ee88cb18 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x14a47870ee88cb11 expref: 21 pid: 5943 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727315.773296:0:8830:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c6e381180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8830:1869324939715712:0@lo:104: 00000100:00100000:1.0:1782727315.773316:0:8830:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c6e383100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8830:1869324939715840:0@lo:104: 00000100:00100000:1.0:1782727315.773325:0:8830:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e45180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8830:1869324939715968:0@lo:104: 00000100:00100000:1.0:1782727315.773333:0:8830:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7dfc2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8830:1869324939716096:0@lo:104: 00000100:00100000:1.0:1782727315.773340:0:8830:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7dfc0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8830:1869324939716224:0@lo:104: 00000100:00100000:1.0:1782727315.773348:0:8830:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7dfc3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8830:1869324939716352:0@lo:104: 00000100:00100000:1.0:1782727315.773355:0:8830:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7dfc1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8830:1869324939716480:0@lo:104: 00010000:00010000:1.0:1782727315.773393:0:8830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff921c43a22000/0x14a47870ee88cbc7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727315.773854:0:5936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1782727315.773866:0:5936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c45e41500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c71e9f0f-6441-4b9b-bc96-153ab9250801+21:3442:x1869324939716992:12345-0@lo:103: 00000100:00100000:0.0:1782727315.774062:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00010000:00010000:3.0:1782727315.774210:0:5936:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782727315.774218:0:5936:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff921c7a3e0e00/0x14a47870ee88cb26 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x14a47870ee88cb1f expref: 21 pid: 5944 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727315.774228:0:5936:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff921c7a3e0e00/0x14a47870ee88cb26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x14a47870ee88cb1f expref: 21 pid: 5944 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727315.774243:0:5936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921c7a3e0e00/0x14a47870ee88cb26 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x14a47870ee88cb1f expref: 21 pid: 5944 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727315.774258:0:5936:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782727315.774430:0:5936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c45e41500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c71e9f0f-6441-4b9b-bc96-153ab9250801+20:3442:x1869324939716992:12345-0@lo:103: Request processed in 565us (1805us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727315.774438:0:5936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1782727315.774455:0:5936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914528512 00000100:00100000:3.0:1782727315.774460:0:5936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914528512 00000100:00100000:1.0:1782727315.774600:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c71e9f0f-6441-4b9b-bc96-153ab9250801:3442:1869324939716992:0@lo:103: 00010000:00010000:3.0:1782727315.774662:0:5936:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff921c7a3e1a00/0x14a47870ee88cb88 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf034 expref: 9 pid: 5944 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727315.774678:0:5936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1782727315.774685:0:5936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dff8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:3442:x1869324939716608:12345-0@lo:103: 00010000:00010000:3.0:1782727315.774695:0:5936:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782727315.774699:0:5936:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff921c429d5600/0x14a47870ee88cb7a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x14a47870ee88cb73 expref: 19 pid: 5944 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727315.774719:0:5936:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff921c429d5600/0x14a47870ee88cb7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x14a47870ee88cb73 expref: 19 pid: 5944 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727315.774729:0:5936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921c429d5600/0x14a47870ee88cb7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x14a47870ee88cb73 expref: 19 pid: 5944 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727315.774739:0:5936:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782727315.774867:0:5936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dff8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c71e9f0f-6441-4b9b-bc96-153ab9250801+18:3442:x1869324939716608:12345-0@lo:103: Request processed in 182us (2153us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727315.774874:0:5936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1782727315.774907:0:5936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1782727315.774914:0:5936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dffb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c71e9f0f-6441-4b9b-bc96-153ab9250801+17:3442:x1869324939717120:12345-0@lo:103: 00010000:00010000:3.0:1782727315.774934:0:5936:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782727315.774940:0:5936:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff921c429d5e00/0x14a47870ee88cb18 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x14a47870ee88cb11 expref: 17 pid: 5943 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727315.774948:0:5936:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff921c429d5e00/0x14a47870ee88cb18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x14a47870ee88cb11 expref: 17 pid: 5943 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727315.774958:0:5936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921c429d5e00/0x14a47870ee88cb18 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x14a47870ee88cb11 expref: 17 pid: 5943 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727315.774967:0:5936:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782727315.774992:0:5936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dffb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c71e9f0f-6441-4b9b-bc96-153ab9250801+16:3442:x1869324939717120:12345-0@lo:103: Request processed in 79us (2239us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727315.774998:0:5936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1782727315.775012:0:5936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 16 00000100:00100000:3.0:1782727315.775019:0:5936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c76441180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ecaf1fda-ff42-4054-9f39-8e142296107b+9:2357:x1869324914528512:12345-192.168.202.60@tcp:103: 00010000:00010000:3.0:1782727315.775033:0:5936:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1782727315.775125:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c6e382d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c71e9f0f-6441-4b9b-bc96-153ab9250801:3444:1869324939716736:0@lo:103: 00000100:00100000:0.0:1782727315.775170:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727315.775196:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c71e9f0f-6441-4b9b-bc96-153ab9250801:3444:1869324939717248:0@lo:103: 00000100:00100000:0.0:1782727315.775221:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727315.775235:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1782727315.775241:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c71e9f0f-6441-4b9b-bc96-153ab9250801:3444:1869324939716864:0@lo:103: 00000100:00100000:0.0:1782727315.775260:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727315.775284:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c71e9f0f-6441-4b9b-bc96-153ab9250801:3444:1869324939717376:0@lo:103: 00000100:00100000:0.0:1782727315.775302:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782727315.776274:0:5936:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff921c7a3e1a00/0x14a47870ee88cb88 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf034 expref: 9 pid: 5944 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727315.776287:0:5936:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff921c7a3e1a00/0x14a47870ee88cb88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf034 expref: 9 pid: 5944 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727315.776302:0:5936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921c7a3e1a00/0x14a47870ee88cb88 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf034 expref: 9 pid: 5944 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727315.776321:0:5936:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782727315.776379:0:5936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c76441180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ecaf1fda-ff42-4054-9f39-8e142296107b+8:2357:x1869324914528512:12345-192.168.202.60@tcp:103: Request processed in 1360us (2319us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727315.776387:0:5936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 16 00000100:00100000:3.0:1782727315.776407:0:5936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939716736 00000100:00100000:3.0:1782727315.776412:0:5936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939716736 00010000:00010000:3.0:1782727315.776431:0:5936:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff921c43a22400/0x14a47870ee88cb50 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x14a47870ee88cb49 expref: 16 pid: 5943 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727315.776445:0:5936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939717248 00000100:00100000:3.0:1782727315.776447:0:5936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939717248 00010000:00010000:3.0:1782727315.776456:0:5936:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff921c4151d000/0x14a47870ee88caee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x14a47870ee88cae7 expref: 17 pid: 5944 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727315.776464:0:5936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939716864 00000100:00100000:3.0:1782727315.776467:0:5936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939716864 00010000:00010000:3.0:1782727315.776656:0:5936:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff921c43a22800/0x14a47870ee88cb34 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x14a47870ee88cb2d expref: 18 pid: 5943 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727315.776670:0:5936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939717376 00000100:00100000:3.0:1782727315.776672:0:5936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939717376 00010000:00010000:3.0:1782727315.776697:0:5936:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff921c43a23400/0x14a47870ee88cac4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x14a47870ee88cabd expref: 19 pid: 5943 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727315.776710:0:5936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1782727315.776717:0:5936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7df61180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:3444:x1869324939716736:12345-0@lo:103: 00010000:00010000:3.0:1782727315.776728:0:5936:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782727315.776731:0:5936:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff921c43a22400/0x14a47870ee88cb50 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x14a47870ee88cb49 expref: 19 pid: 5943 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727315.776739:0:5936:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff921c43a22400/0x14a47870ee88cb50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x14a47870ee88cb49 expref: 19 pid: 5943 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727315.776748:0:5936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921c43a22400/0x14a47870ee88cb50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x14a47870ee88cb49 expref: 19 pid: 5943 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727315.776757:0:5936:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782727315.776803:0:5936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7df61180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c71e9f0f-6441-4b9b-bc96-153ab9250801+18:3444:x1869324939716736:12345-0@lo:103: Request processed in 87us (1633us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727315.776810:0:5936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1782727315.776823:0:5936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1782727315.776829:0:5936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5302e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c71e9f0f-6441-4b9b-bc96-153ab9250801+17:3444:x1869324939717248:12345-0@lo:103: 00010000:00010000:3.0:1782727315.776836:0:5936:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782727315.776840:0:5936:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff921c4151d000/0x14a47870ee88caee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x14a47870ee88cae7 expref: 17 pid: 5944 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727315.776848:0:5936:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff921c4151d000/0x14a47870ee88caee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x14a47870ee88cae7 expref: 17 pid: 5944 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727315.776857:0:5936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921c4151d000/0x14a47870ee88caee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x14a47870ee88cae7 expref: 17 pid: 5944 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727315.776874:0:5936:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782727315.776923:0:5936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5302e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c71e9f0f-6441-4b9b-bc96-153ab9250801+16:3444:x1869324939717248:12345-0@lo:103: Request processed in 93us (1701us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727315.776929:0:5936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1782727315.776964:0:5936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1782727315.776970:0:5936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7df63b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c71e9f0f-6441-4b9b-bc96-153ab9250801+15:3444:x1869324939716864:12345-0@lo:103: 00010000:00010000:3.0:1782727315.776977:0:5936:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782727315.776981:0:5936:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff921c43a22800/0x14a47870ee88cb34 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x14a47870ee88cb2d expref: 15 pid: 5943 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727315.776990:0:5936:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff921c43a22800/0x14a47870ee88cb34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x14a47870ee88cb2d expref: 15 pid: 5943 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727315.776999:0:5936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921c43a22800/0x14a47870ee88cb34 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x14a47870ee88cb2d expref: 15 pid: 5943 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727315.777007:0:5936:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782727315.777029:0:5936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7df63b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c71e9f0f-6441-4b9b-bc96-153ab9250801+14:3444:x1869324939716864:12345-0@lo:103: Request processed in 59us (1768us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727315.777034:0:5936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1782727315.777058:0:5936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1782727315.777181:0:5936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7df62300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c71e9f0f-6441-4b9b-bc96-153ab9250801+13:3444:x1869324939717376:12345-0@lo:103: 00010000:00010000:3.0:1782727315.777192:0:5936:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782727315.777197:0:5936:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff921c43a23400/0x14a47870ee88cac4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x14a47870ee88cabd expref: 13 pid: 5943 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727315.777206:0:5936:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff921c43a23400/0x14a47870ee88cac4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x14a47870ee88cabd expref: 13 pid: 5943 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727315.777223:0:5936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921c43a23400/0x14a47870ee88cac4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x14a47870ee88cabd expref: 13 pid: 5943 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727315.777233:0:5936:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff921c43a22000/0x14a47870ee88cbc7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727315.777242:0:5936:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921c43a22000/0x14a47870ee88cbc7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727315.777257:0:5936:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff921c43a22000/0x14a47870ee88cbc7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727315.778739:0:5936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff921c43a22000/0x14a47870ee88cbc7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727315.778748:0:5936:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff921c43a22000/0x14a47870ee88cbc7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727315.778755:0:5936:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff921c43a22000/0x14a47870ee88cbc7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727315.778761:0:5936:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c43a22000 already unused, calling callback (ffffffffc0c98cf0) 00010000:00010000:3.0:1782727315.778765:0:5936:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff921c43a22000/0x14a47870ee88cbc7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727315.778774:0:5936:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff921c43a22000/0x14a47870ee88cbc7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727315.778871:0:5932:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00000100:00100000:2.0:1782727315.778976:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c71e9f0f-6441-4b9b-bc96-153ab9250801:3444:1869324939716864:0@lo:103: 00000100:00100000:2.0:1782727315.778989:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c6e382d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c71e9f0f-6441-4b9b-bc96-153ab9250801:3444:1869324939716736:0@lo:103: 00000100:00100000:2.0:1782727315.778997:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c71e9f0f-6441-4b9b-bc96-153ab9250801:3444:1869324939717248:0@lo:103: 00000100:00100000:1.0:1782727315.783931:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7df21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c71e9f0f-6441-4b9b-bc96-153ab9250801:3442:1869324939716608:0@lo:103: 00000100:00100000:1.0:1782727315.783946:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c71e9f0f-6441-4b9b-bc96-153ab9250801:3442:1869324939717120:0@lo:103: 00010000:00010000:0.0:1782727315.784237:0:8830:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff921c43a22000/0x14a47870ee88cbc7 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727315.784249:0:8830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff921c43a22000/0x14a47870ee88cbc7 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727315.784385:0:5936:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff921c43a22000/0x14a47870ee88cbc7 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727315.784416:0:5936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921c43a22000/0x14a47870ee88cbc7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727315.784436:0:5936:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782727315.785608:0:5936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7df62300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c71e9f0f-6441-4b9b-bc96-153ab9250801+12:3444:x1869324939717376:12345-0@lo:103: Request processed in 8538us (10298us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727315.785622:0:5936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1782727315.787957:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c71e9f0f-6441-4b9b-bc96-153ab9250801:3444:1869324939717376:0@lo:103: 00010000:00010000:3.0:1782727315.897003:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727316.153375:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782727316.153395:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7d6e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869324939717504:0@lo:13: 00000100:00100000:0.0:1782727316.153449:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727316.153975:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7dffad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869324939718016:0@lo:400: 00000100:00100000:3.0:1782727316.154019:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727316.154055:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782727316.154061:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7dff8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3442:1869324939717632:0@lo:400: 00000100:00100000:3.0:1782727316.154089:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727316.154118:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7dffaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3445:1869324939717888:0@lo:400: 00000100:00100000:3.0:1782727316.154142:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727316.154156:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782727316.154160:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7dffb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3445:1869324939717760:0@lo:400: 00000100:00100000:3.0:1782727316.154173:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727316.154189:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939717632 00000100:00100000:3.0:1782727316.154194:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939717632 00000100:00100000:3.0:1782727316.154219:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939717888 00000100:00100000:3.0:1782727316.154220:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939717888 00000100:00100000:3.0:1782727316.154233:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939717760 00000100:00100000:3.0:1782727316.154235:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939717760 00000100:00100000:3.0:1782727316.154243:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1782727316.154248:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dffb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1869324939717632:12345-0@lo:400: 00000100:00100000:3.0:1782727316.154283:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dffb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1869324939717632:12345-0@lo:400: Request processed in 34us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727316.154303:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1782727316.154318:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1782727316.154324:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dff9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1869324939717888:12345-0@lo:400: 00000100:00100000:3.0:1782727316.154355:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dff9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1869324939717888:12345-0@lo:400: Request processed in 32us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727316.154360:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1782727316.154368:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1782727316.154372:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dff9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3445:x1869324939717760:12345-0@lo:400: 00000100:00100000:3.0:1782727316.154388:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dff9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3445:x1869324939717760:12345-0@lo:400: Request processed in 17us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727316.154392:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1782727316.154404:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782727316.154423:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7dffb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3445:1869324939717760:0@lo:400: 00000100:00100000:3.0:1782727316.154430:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7dffaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3445:1869324939717888:0@lo:400: 00000100:00100000:3.0:1782727316.154447:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7dff8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3442:1869324939717632:0@lo:400: 00000100:00100000:2.0:1782727316.154835:0:6952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939717504 00000100:00100000:2.0:1782727316.154842:0:6952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939717504 00000100:00100000:2.0:1782727316.154880:0:6952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1782727316.154906:0:6952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7df60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1869324939717504:12345-0@lo:13: 00002000:00000024:2.0:1782727316.154927:0:6952:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1782727316.154963:0:6952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7df60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1869324939717504:12345-0@lo:13: Request processed in 59us (1512us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727316.154968:0:6952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1782727316.154985:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782727316.155105:0:6950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939718016 00000100:00100000:0.0:1782727316.155109:0:6950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939718016 00000100:00100000:0.0:1782727316.155140:0:6950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782727316.155146:0:6950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dff8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3442:x1869324939718016:12345-0@lo:400: 00000100:00100000:0.0:1782727316.155190:0:6950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dff8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3442:x1869324939718016:12345-0@lo:400: Request processed in 45us (1171us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727316.155196:0:6950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782727316.155226:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7df60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869324939718144:0@lo:13: 00000100:00100000:0.0:1782727316.155252:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1782727316.155300:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c7d6e9180 x1869324939717504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727332 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727316.155317:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7d6e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869324939717504:0@lo:13: 00000100:00080000:2.0:1782727316.156178:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782727316.156191:0:6952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939718144 00000100:00100000:2.0:1782727316.156197:0:6952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939718144 00000100:00100000:2.0:1782727316.156239:0:6952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1782727316.156246:0:6952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7df63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1869324939718144:12345-0@lo:13: 00002000:00000024:2.0:1782727316.156276:0:6952:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1782727316.156319:0:6952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7df63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1869324939718144:12345-0@lo:13: Request processed in 73us (1065us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727316.156325:0:6952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1782727316.156365:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c7dffad80 x1869324939718016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727316.156376:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7dffad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869324939718016:0@lo:400: 00010000:00080000:0.0:1782727316.156733:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c7df60e00 x1869324939718144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727332 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727316.156746:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7df60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869324939718144:0@lo:13: 00000100:00100000:2.0:1782727316.485083:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1782727316.485127:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1782727316.485184:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1782727316.485224:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1782727316.485321:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914528640 00000100:00100000:1.0:1782727316.485331:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914528640 00000100:00100000:1.0:1782727316.485390:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 132 00000100:00100000:1.0:1782727316.485400:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fdb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecaf1fda-ff42-4054-9f39-8e142296107b+8:2355:x1869324914528640:12345-192.168.202.60@tcp:400: 00000100:00100000:1.0:1782727316.485489:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fdb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecaf1fda-ff42-4054-9f39-8e142296107b+8:2355:x1869324914528640:12345-192.168.202.60@tcp:400: Request processed in 84us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727316.485498:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 132 00000100:00100000:3.0:1782727316.485613:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914528768 00000100:00100000:3.0:1782727316.485617:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914528768 00000100:00100000:3.0:1782727316.485665:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 30 00000100:00100000:3.0:1782727316.485672:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7d6ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d85bc959-008e-4782-8f39-df709fbb4636+6:2355:x1869324914528768:12345-192.168.202.60@tcp:400: 00000100:00100000:3.0:1782727316.485704:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7d6ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d85bc959-008e-4782-8f39-df709fbb4636+6:2355:x1869324914528768:12345-192.168.202.60@tcp:400: Request processed in 32us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727316.485710:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 30 00000100:00080000:1.0:1782727316.485771:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782727316.490141:0:6951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914529024 00000100:00100000:0.0:1782727316.490157:0:6951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914529024 00000100:00100000:0.0:1782727316.490254:0:6951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914528896 00000100:00100000:0.0:1782727316.490258:0:6951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914528896 00000100:00100000:0.0:1782727316.490281:0:6951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 8 00000100:00100000:0.0:1782727316.490291:0:6951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7d6e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d85bc959-008e-4782-8f39-df709fbb4636+5:2355:x1869324914529024:12345-192.168.202.60@tcp:400: 00000100:00100000:0.0:1782727316.490365:0:6951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7d6e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d85bc959-008e-4782-8f39-df709fbb4636+5:2355:x1869324914529024:12345-192.168.202.60@tcp:400: Request processed in 75us (5237us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727316.490373:0:6951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 8 00000100:00100000:0.0:1782727316.490391:0:6951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 9 00000100:00100000:0.0:1782727316.490398:0:6951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7d6e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d85bc959-008e-4782-8f39-df709fbb4636+5:2355:x1869324914528896:12345-192.168.202.60@tcp:400: 00000100:00100000:0.0:1782727316.490421:0:6951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7d6e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d85bc959-008e-4782-8f39-df709fbb4636+5:2355:x1869324914528896:12345-192.168.202.60@tcp:400: Request processed in 25us (5198us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727316.490427:0:6951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 9 00000100:00080000:1.0:1782727316.490522:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782727316.490526:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1782727316.921108:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782727317.817016:0:5946:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1782727317.817034:0:5946:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff921c7d8c0800 from 39 10000000:01000000:0.0:1782727317.817040:0:5946:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1782727317.817092:0:5946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff921c7a3e0600/0x14a47870ee88cbce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727317.817104:0:5946:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff921c7a3e0600/0x14a47870ee88cbce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727317.817115:0:5946:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff921c7a3e0600/0x14a47870ee88cbce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727317.817141:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7df60e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939718272:0@lo:101: 00000100:00100000:0.0:1782727317.817215:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727317.817296:0:5946:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c42de46c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782727317.817398:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939718272 00000100:00100000:1.0:1782727317.817405:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939718272 00000100:00100000:1.0:1782727317.817476:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1782727317.817485:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fdb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+12:5946:x1869324939718272:12345-0@lo:101: 00010000:00010000:1.0:1782727317.817501:0:5942:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727317.817515:0:5942:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921c43a23a00/0x14a47870ee88cbd5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x14a47870ee88cbce expref: -99 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727317.817539:0:5942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921c43a23a00/0x14a47870ee88cbd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x14a47870ee88cbce expref: 13 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727317.817549:0:5942:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921c43a23a00/0x14a47870ee88cbd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x14a47870ee88cbce expref: 13 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727317.817576:0:5942:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c43a23a00, rc 0) 00000100:00100000:1.0:1782727317.817621:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fdb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+13:5946:x1869324939718272:12345-0@lo:101: Request processed in 136us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727317.817628:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1782727317.818231:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7df60e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939718272:0@lo:101: 00010000:00010000:2.0:1782727317.818250:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff921c7a3e0600/0x14a47870ee88cbce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88cbd5 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727317.818259:0:5946:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff921c7a3e0600/0x14a47870ee88cbce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x14a47870ee88cbd5 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727317.818355:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7d6eb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939718400:0@lo:501: 00000100:00100000:2.0:1782727317.818390:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727317.818431:0:5946:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c7d6c1780 going to sleep for 11 seconds 00000100:00100000:1.0:1782727317.819582:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939718400 00000100:00100000:1.0:1782727317.819590:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939718400 00000100:00100000:1.0:1782727317.819648:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1782727317.819657:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fdb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+13:5946:x1869324939718400:12345-0@lo:501: 00000100:00100000:1.0:1782727317.819797:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fdb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+13:5946:x1869324939718400:12345-0@lo:501: Request processed in 140us (1404us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727317.819805:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1782727317.819828:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7d6eb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939718400:0@lo:501: 00000100:00100000:2.0:1782727317.819871:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7d6eb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939718528:0@lo:503: 00000100:00100000:2.0:1782727317.819951:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727317.820181:0:5946:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c7d6c1780 going to sleep for 11 seconds 00000100:00100000:0.0:1782727317.820217:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939718528 00000100:00100000:0.0:1782727317.820221:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939718528 00000100:00100000:0.0:1782727317.820398:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1782727317.820407:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fdb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+13:5946:x1869324939718528:12345-0@lo:503: 00000100:00100000:0.0:1782727317.820519:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fdb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+13:5946:x1869324939718528:12345-0@lo:503: Request processed in 113us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727317.820526:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1782727317.820627:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7d6eb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939718528:0@lo:503: 00000100:00100000:3.0:1782727317.821957:0:8847:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7dff8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c71e9f0f-6441-4b9b-bc96-153ab9250801:8847:1869324939718656:0@lo:502: 00000100:00100000:3.0:1782727317.822039:0:8847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727317.825931:0:8847:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c7667ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1782727317.826087:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939718656 00000100:00100000:2.0:1782727317.826098:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939718656 00000100:00100000:2.0:1782727317.829031:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1782727317.829055:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fdb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+13:8847:x1869324939718656:12345-0@lo:502: 00000100:00100000:2.0:1782727317.829235:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fdb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+13:8847:x1869324939718656:12345-0@lo:502: Request processed in 192us (7193us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727317.829243:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1782727317.829495:0:8847:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7dff8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c71e9f0f-6441-4b9b-bc96-153ab9250801:8847:1869324939718656:0@lo:502: 00000100:00100000:3.0:1782727317.829563:0:8847:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7dff8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c71e9f0f-6441-4b9b-bc96-153ab9250801:8847:1869324939718784:0@lo:502: 00000100:00100000:3.0:1782727317.829611:0:8847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727317.829639:0:8847:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c7667ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1782727317.829779:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939718784 00000100:00100000:2.0:1782727317.829786:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939718784 00000100:00100000:2.0:1782727317.829807:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1782727317.829813:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fdb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+13:8847:x1869324939718784:12345-0@lo:502: 00000100:00100000:2.0:1782727317.829921:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fdb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+13:8847:x1869324939718784:12345-0@lo:502: Request processed in 106us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727317.829927:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1782727317.830537:0:8847:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7dff8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c71e9f0f-6441-4b9b-bc96-153ab9250801:8847:1869324939718784:0@lo:502: 00000040:00080000:3.0:1782727317.830564:0:8847:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1782727317.830971:0:5946:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1782727317.831006:0:5946:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782727317.831016:0:5946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff921c7a3e0600/0x14a47870ee88cbce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88cbd5 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727317.831037:0:5946:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff921c7a3e0600/0x14a47870ee88cbce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88cbd5 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782727317.831046:0:5946:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1782727317.831049:0:5946:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1782727317.831052:0:5946:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1782727317.831083:0:5946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff921c429d5c00/0x14a47870ee88cbdc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727317.831092:0:5946:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff921c429d5c00/0x14a47870ee88cbdc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727317.831101:0:5946:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff921c429d5c00/0x14a47870ee88cbdc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727317.831117:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7d6eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939718912:0@lo:101: 00000100:00100000:2.0:1782727317.831163:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727317.831402:0:5946:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c7d6c1540 going to sleep for 11 seconds 00000100:00100000:3.0:1782727317.835460:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939718912 00000100:00100000:3.0:1782727317.835479:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939718912 00000100:00100000:3.0:1782727317.835660:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1782727317.835669:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fdb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+13:5946:x1869324939718912:12345-0@lo:101: 00010000:00010000:3.0:1782727317.835688:0:5942:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727317.835707:0:5942:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921c4151d000/0x14a47870ee88cbe3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x14a47870ee88cbdc expref: -99 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727317.835738:0:5942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921c4151d000/0x14a47870ee88cbe3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x14a47870ee88cbdc expref: 14 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727317.835748:0:5942:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921c4151d000/0x14a47870ee88cbe3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x14a47870ee88cbdc expref: 14 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727317.835758:0:5942:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c4151d000, rc 0) 00000100:00100000:3.0:1782727317.835836:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fdb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+14:5946:x1869324939718912:12345-0@lo:101: Request processed in 168us (4673us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727317.835843:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1782727317.836102:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7d6eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939718912:0@lo:101: 00010000:00010000:2.0:1782727317.836122:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff921c429d5c00/0x14a47870ee88cbdc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88cbe3 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727317.836144:0:5946:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff921c429d5c00/0x14a47870ee88cbdc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x14a47870ee88cbe3 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727317.836218:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7d6eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939719040:0@lo:501: 00000100:00100000:2.0:1782727317.836267:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727317.836294:0:5946:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c7d6c1540 going to sleep for 11 seconds 00000100:00100000:3.0:1782727317.836469:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939719040 00000100:00100000:3.0:1782727317.836474:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939719040 00000100:00100000:3.0:1782727317.836512:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1782727317.836519:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fdb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+14:5946:x1869324939719040:12345-0@lo:501: 00000100:00100000:3.0:1782727317.836658:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fdb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+14:5946:x1869324939719040:12345-0@lo:501: Request processed in 138us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727317.836665:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1782727317.837450:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7d6eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939719040:0@lo:501: 00000100:00100000:2.0:1782727317.837509:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7d6eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939719168:0@lo:503: 00000100:00100000:2.0:1782727317.837564:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727317.837596:0:5946:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c7d6c1540 going to sleep for 11 seconds 00000100:00100000:3.0:1782727317.837791:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939719168 00000100:00100000:3.0:1782727317.837798:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939719168 00000100:00100000:3.0:1782727317.837831:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1782727317.837838:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fdb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+14:5946:x1869324939719168:12345-0@lo:503: 00000100:00100000:3.0:1782727317.837961:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fdb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+14:5946:x1869324939719168:12345-0@lo:503: Request processed in 122us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727317.837967:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1782727317.838274:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7d6eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939719168:0@lo:503: 00000100:00100000:2.0:1782727317.839001:0:8848:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7d6eaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c71e9f0f-6441-4b9b-bc96-153ab9250801:8848:1869324939719296:0@lo:502: 00000100:00100000:2.0:1782727317.839183:0:8848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727317.839216:0:8848:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c7d6c1e40 going to sleep for 11 seconds 00000100:00100000:3.0:1782727317.839300:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939719296 00000100:00100000:3.0:1782727317.839306:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939719296 00000100:00100000:3.0:1782727317.839338:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1782727317.839346:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fdb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+14:8848:x1869324939719296:12345-0@lo:502: 00000100:00100000:3.0:1782727317.839456:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fdb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+14:8848:x1869324939719296:12345-0@lo:502: Request processed in 109us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727317.839463:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1782727317.839759:0:8848:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7d6eaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c71e9f0f-6441-4b9b-bc96-153ab9250801:8848:1869324939719296:0@lo:502: 00000020:01000000:2.0:1782727317.839788:0:8848:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782727317.839797:0:8848:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782727317.839800:0:8848:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1782727317.839805:0:8848:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1782727317.839832:0:8848:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7d6eaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c71e9f0f-6441-4b9b-bc96-153ab9250801:8848:1869324939719424:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782727317.839864:0:8848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727317.839880:0:8848:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c7d6c1e40 going to sleep for 11 seconds 00000100:00100000:3.0:1782727317.840146:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939719424 00000100:00100000:3.0:1782727317.840151:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939719424 00000100:00100000:3.0:1782727317.840174:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1782727317.840181:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fdb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+14:8848:x1869324939719424:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782727317.840330:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fdb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+14:8848:x1869324939719424:12345-0@lo:502:llog_process_th.0 Request processed in 147us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727317.840346:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1782727317.840559:0:8848:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7d6eaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c71e9f0f-6441-4b9b-bc96-153ab9250801:8848:1869324939719424:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782727317.840581:0:8848:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782727317.840591:0:8848:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782727317.840593:0:8848:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1782727317.840598:0:8848:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1782727317.840762:0:5946:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1782727317.840782:0:5946:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1782727317.840792:0:5946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff921c429d5c00/0x14a47870ee88cbdc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88cbe3 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727317.840803:0:5946:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff921c429d5c00/0x14a47870ee88cbdc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88cbe3 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727317.840813:0:5946:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1782727317.840815:0:5946:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff921c45e6f800 from 39 10000000:01000000:3.0:1782727317.840819:0:5946:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1782727317.840847:0:5946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff921c4151c400/0x14a47870ee88cbea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727317.840855:0:5946:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff921c4151c400/0x14a47870ee88cbea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727317.840865:0:5946:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff921c4151c400/0x14a47870ee88cbea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727317.841239:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7dff8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939719552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782727317.841376:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727317.841447:0:5946:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c7667ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1782727317.841512:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939719552 00000100:00100000:1.0:1782727317.841519:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939719552 00000100:00100000:2.0:1782727317.841630:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1782727317.841639:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fdb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+14:5946:x1869324939719552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782727317.841652:0:5942:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727317.841667:0:5942:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921c429d4400/0x14a47870ee88cbf1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x14a47870ee88cbea expref: -99 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727317.841691:0:5942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921c429d4400/0x14a47870ee88cbf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x14a47870ee88cbea expref: 15 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727317.841702:0:5942:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921c429d4400/0x14a47870ee88cbf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x14a47870ee88cbea expref: 15 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727317.841709:0:5942:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c429d4400, rc 0) 00000100:00100000:2.0:1782727317.841784:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fdb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+15:5946:x1869324939719552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727317.841791:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1782727317.842212:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7dff8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939719552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782727317.842229:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff921c4151c400/0x14a47870ee88cbea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88cbf1 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727317.842333:0:5946:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff921c4151c400/0x14a47870ee88cbea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x14a47870ee88cbf1 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727317.842403:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7dff8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939719680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782727317.842436:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727317.842683:0:5946:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c7667ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1782727317.842722:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939719680 00000100:00100000:2.0:1782727317.842728:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939719680 00000100:00100000:2.0:1782727317.842815:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1782727317.842824:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fdb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+15:5946:x1869324939719680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782727317.842977:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fdb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+15:5946:x1869324939719680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 154us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727317.842984:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1782727317.843079:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7dff8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939719680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782727317.843110:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7dff8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939719808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782727317.843153:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727317.843652:0:5946:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c7667ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1782727317.843718:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939719808 00000100:00100000:1.0:1782727317.843725:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939719808 00000100:00100000:1.0:1782727317.843756:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1782727317.843764:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fdb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+15:5946:x1869324939719808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782727317.843868:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fdb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+15:5946:x1869324939719808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 105us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727317.843876:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1782727317.844390:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7dff8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939719808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782727317.844806:0:8849:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7d6eaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c71e9f0f-6441-4b9b-bc96-153ab9250801:8849:1869324939719936:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782727317.844855:0:8849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727317.844912:0:8849:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c7d6c1780 going to sleep for 11 seconds 00000100:00100000:1.0:1782727317.844989:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939719936 00000100:00100000:1.0:1782727317.844994:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939719936 00000100:00100000:1.0:1782727317.845126:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1782727317.845135:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fd13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+15:8849:x1869324939719936:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782727317.845241:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fd13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+15:8849:x1869324939719936:12345-0@lo:502:llog_process_th.0 Request processed in 106us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727317.845267:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1782727317.845344:0:8849:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7d6eaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c71e9f0f-6441-4b9b-bc96-153ab9250801:8849:1869324939719936:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782727317.845384:0:8849:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7dffaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c71e9f0f-6441-4b9b-bc96-153ab9250801:8849:1869324939720064:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782727317.845417:0:8849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727317.845706:0:8849:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c7667af00 going to sleep for 11 seconds 00000100:00100000:0.0:1782727317.845736:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939720064 00000100:00100000:0.0:1782727317.845740:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939720064 00000100:00100000:0.0:1782727317.845766:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1782727317.845773:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fd13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+15:8849:x1869324939720064:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782727317.845863:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fd13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+15:8849:x1869324939720064:12345-0@lo:502:llog_process_th.0 Request processed in 90us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727317.845870:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1782727317.845997:0:8849:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7dffaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c71e9f0f-6441-4b9b-bc96-153ab9250801:8849:1869324939720064:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1782727317.846016:0:8849:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1782727317.846222:0:5946:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1782727317.846247:0:5946:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1782727317.846509:0:5946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff921c4151c400/0x14a47870ee88cbea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88cbf1 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727317.846520:0:5946:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff921c4151c400/0x14a47870ee88cbea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88cbf1 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782727317.846529:0:5946:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1782727317.846532:0:5946:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1782727317.846534:0:5946:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1782727317.846564:0:5946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff921c7a3e0200/0x14a47870ee88cbf8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727317.846571:0:5946:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff921c7a3e0200/0x14a47870ee88cbf8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727317.846580:0:5946:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff921c7a3e0200/0x14a47870ee88cbf8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727317.846598:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7df62a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939720192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782727317.846633:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727317.846667:0:5946:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c42de46c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782727317.846723:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939720192 00000100:00100000:3.0:1782727317.846727:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939720192 00000100:00100000:3.0:1782727317.846750:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1782727317.846757:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fd12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+15:5946:x1869324939720192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782727317.846766:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727317.846778:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921c4151c000/0x14a47870ee88cbff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x14a47870ee88cbf8 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727317.846813:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921c4151c000/0x14a47870ee88cbff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x14a47870ee88cbf8 expref: 16 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727317.846823:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921c4151c000/0x14a47870ee88cbff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x14a47870ee88cbf8 expref: 16 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727317.846832:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c4151c000, rc 0) 00000100:00100000:3.0:1782727317.846874:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fd12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+16:5946:x1869324939720192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727317.846880:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1782727317.847079:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7df62a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939720192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782727317.847093:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff921c7a3e0200/0x14a47870ee88cbf8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88cbff expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727317.847103:0:5946:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff921c7a3e0200/0x14a47870ee88cbf8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x14a47870ee88cbff expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727317.847167:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7df62a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939720320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782727317.847191:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727317.847218:0:5946:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c42de46c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782727317.850229:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939720320 00000100:00100000:3.0:1782727317.850243:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939720320 00000100:00100000:3.0:1782727317.850312:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1782727317.850321:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fd10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+16:5946:x1869324939720320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782727317.850496:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fd10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+16:5946:x1869324939720320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 176us (3302us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727317.850505:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1782727317.850816:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7df62a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939720320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782727317.850869:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7df62a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939720448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782727317.850955:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727317.850987:0:5946:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c42de46c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782727317.851139:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939720448 00000100:00100000:3.0:1782727317.851144:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939720448 00000100:00100000:3.0:1782727317.851165:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1782727317.851170:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fd11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+16:5946:x1869324939720448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782727317.851249:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fd11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+16:5946:x1869324939720448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727317.851349:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7df62a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939720448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782727317.851611:0:8850:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7df62a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c71e9f0f-6441-4b9b-bc96-153ab9250801:8850:1869324939720576:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782727317.851646:0:8850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727317.851660:0:8850:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c42de4d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782727317.851785:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939720576 00000100:00100000:2.0:1782727317.851791:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939720576 00000100:00100000:2.0:1782727317.851818:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1782727317.851825:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fd10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+17:8850:x1869324939720576:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782727317.851935:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fd10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+17:8850:x1869324939720576:12345-0@lo:502:llog_process_th.0 Request processed in 110us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727317.851943:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1782727317.852804:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1782727317.852989:0:8850:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7df62a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c71e9f0f-6441-4b9b-bc96-153ab9250801:8850:1869324939720576:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782727317.853908:0:8850:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782727317.853921:0:8850:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782727317.853923:0:8850:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1782727317.853930:0:8850:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1782727317.853972:0:8850:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7df62a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c71e9f0f-6441-4b9b-bc96-153ab9250801:8850:1869324939720704:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782727317.854048:0:8850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727317.854082:0:8850:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c49b653c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782727317.854245:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939720704 00000100:00100000:3.0:1782727317.854251:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939720704 00000100:00100000:3.0:1782727317.854355:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1782727317.854362:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fd12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+16:8850:x1869324939720704:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782727317.854469:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fd12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+16:8850:x1869324939720704:12345-0@lo:502:llog_process_th.0 Request processed in 106us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727317.854476:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1782727317.856292:0:8850:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7df62a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c71e9f0f-6441-4b9b-bc96-153ab9250801:8850:1869324939720704:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782727317.856332:0:8850:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782727317.856340:0:8850:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782727317.856342:0:8850:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1782727317.856346:0:8850:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:0.0:1782727317.856577:0:5946:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1782727317.856597:0:5946:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1782727317.856607:0:5946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff921c7a3e0200/0x14a47870ee88cbf8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88cbff expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727317.856633:0:5946:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff921c7a3e0200/0x14a47870ee88cbf8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88cbff expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782727317.856643:0:5946:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1782727317.856646:0:5946:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff921c479c5800 from 39 10000000:01000000:0.0:1782727317.856648:0:5946:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1782727317.856678:0:5946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff921c7a3e0800/0x14a47870ee88cc06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727317.856685:0:5946:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff921c7a3e0800/0x14a47870ee88cc06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727317.856695:0:5946:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff921c7a3e0800/0x14a47870ee88cc06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727317.856713:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7df62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939720832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782727317.856763:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727317.856799:0:5946:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c42de4d80 going to sleep for 11 seconds 00000100:00100000:1.0:1782727317.857026:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939720832 00000100:00100000:1.0:1782727317.857032:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939720832 00000100:00100000:1.0:1782727317.857078:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1782727317.857087:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fd11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+16:5946:x1869324939720832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782727317.857099:0:5943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727317.857111:0:5943:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921c43a22000/0x14a47870ee88cc0d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x14a47870ee88cc06 expref: -99 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727317.857136:0:5943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921c43a22000/0x14a47870ee88cc0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x14a47870ee88cc06 expref: 17 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727317.857146:0:5943:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921c43a22000/0x14a47870ee88cc0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x14a47870ee88cc06 expref: 17 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727317.857155:0:5943:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c43a22000, rc 0) 00000100:00100000:1.0:1782727317.857192:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fd11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+17:5946:x1869324939720832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727317.857199:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1782727317.857390:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7df62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939720832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782727317.857402:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff921c7a3e0800/0x14a47870ee88cc06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88cc0d expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727317.857410:0:5946:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff921c7a3e0800/0x14a47870ee88cc06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x14a47870ee88cc0d expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727317.857464:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7df62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939720960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782727317.857490:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727317.857534:0:5946:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c42de4d80 going to sleep for 11 seconds 00000100:00100000:3.0:1782727317.857672:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939720960 00000100:00100000:3.0:1782727317.857676:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939720960 00000100:00100000:3.0:1782727317.857701:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1782727317.857708:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fd10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+17:5946:x1869324939720960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782727317.857829:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fd10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+17:5946:x1869324939720960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 121us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727317.857836:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1782727317.857998:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7df62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939720960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782727317.858041:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7df62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939721088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782727317.858078:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727317.858106:0:5946:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c42de4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1782727317.858119:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939721088 00000100:00100000:0.0:1782727317.858122:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939721088 00000100:00100000:0.0:1782727317.858151:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1782727317.858157:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fd11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+17:5946:x1869324939721088:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782727317.858232:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fd11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+17:5946:x1869324939721088:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727317.858238:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1782727317.858294:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7df62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939721088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782727317.858521:0:8851:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7df62d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c71e9f0f-6441-4b9b-bc96-153ab9250801:8851:1869324939721216:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782727317.858555:0:8851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727317.858573:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939721216 00000100:00100000:0.0:1782727317.858576:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939721216 00000100:00100000:0.0:1782727317.858593:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1782727317.858598:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fd12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+17:8851:x1869324939721216:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782727317.858662:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fd12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+17:8851:x1869324939721216:12345-0@lo:502:llog_process_th.0 Request processed in 63us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727317.858668:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1782727317.858698:0:8851:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c42de4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1782727317.858710:0:8851:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7df62d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c71e9f0f-6441-4b9b-bc96-153ab9250801:8851:1869324939721216:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782727317.858745:0:8851:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7df62d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c71e9f0f-6441-4b9b-bc96-153ab9250801:8851:1869324939721344:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782727317.858780:0:8851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727317.858797:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939721344 00000100:00100000:0.0:1782727317.858800:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939721344 00000100:00100000:0.0:1782727317.858817:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1782727317.858823:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fd13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+17:8851:x1869324939721344:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782727317.858878:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fd13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+17:8851:x1869324939721344:12345-0@lo:502:llog_process_th.0 Request processed in 54us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727317.858916:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1782727317.858945:0:8851:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c42de4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1782727317.858957:0:8851:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7df62d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c71e9f0f-6441-4b9b-bc96-153ab9250801:8851:1869324939721344:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1782727317.858977:0:8851:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1782727317.859037:0:5946:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1782727317.859072:0:5946:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1782727317.859081:0:5946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff921c7a3e0800/0x14a47870ee88cc06 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88cc0d expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727317.859089:0:5946:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff921c7a3e0800/0x14a47870ee88cc06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88cc0d expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782727317.859098:0:5946:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1782727317.859100:0:5946:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1782727317.859102:0:5946:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1782727317.859126:0:5946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff921c7a3e0400/0x14a47870ee88cc14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727317.859133:0:5946:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff921c7a3e0400/0x14a47870ee88cc14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727317.859152:0:5946:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff921c7a3e0400/0x14a47870ee88cc14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727317.859164:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7df62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939721472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782727317.859188:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727317.859202:0:5946:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c42de4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1782727317.859212:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939721472 00000100:00100000:0.0:1782727317.859216:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939721472 00000100:00100000:0.0:1782727317.859232:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1782727317.859238:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fd10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+17:5946:x1869324939721472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782727317.859245:0:5943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727317.859255:0:5943:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921c7a3e1600/0x14a47870ee88cc1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x14a47870ee88cc14 expref: -99 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727317.859273:0:5943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921c7a3e1600/0x14a47870ee88cc1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x14a47870ee88cc14 expref: 18 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727317.859282:0:5943:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921c7a3e1600/0x14a47870ee88cc1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x14a47870ee88cc14 expref: 18 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727317.859290:0:5943:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c7a3e1600, rc 0) 00000100:00100000:0.0:1782727317.859323:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fd10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+18:5946:x1869324939721472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 85us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727317.859329:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1782727317.859355:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7df62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939721472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782727317.859366:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff921c7a3e0400/0x14a47870ee88cc14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88cc1b expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727317.859380:0:5946:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff921c7a3e0400/0x14a47870ee88cc14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x14a47870ee88cc1b expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727317.859420:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7df62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939721600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782727317.859444:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727317.859457:0:5946:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c42de4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1782727317.859468:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939721600 00000100:00100000:0.0:1782727317.859471:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939721600 00000100:00100000:0.0:1782727317.859488:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1782727317.859493:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fd12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+18:5946:x1869324939721600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782727317.859588:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fd12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+18:5946:x1869324939721600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 94us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727317.859594:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1782727317.859621:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7df62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939721600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782727317.859644:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7df62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939721728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782727317.859678:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727317.859693:0:5946:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c42de4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1782727317.859703:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939721728 00000100:00100000:0.0:1782727317.859706:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939721728 00000100:00100000:0.0:1782727317.859722:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1782727317.859728:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fd13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+18:5946:x1869324939721728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782727317.859794:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fd13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+18:5946:x1869324939721728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 66us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727317.859800:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1782727317.859850:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7df62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939721728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782727317.860137:0:8852:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7df62d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c71e9f0f-6441-4b9b-bc96-153ab9250801:8852:1869324939721856:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782727317.860171:0:8852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727317.860188:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939721856 00000100:00100000:0.0:1782727317.860192:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939721856 00000100:00100000:0.0:1782727317.860209:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1782727317.860215:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fd11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+18:8852:x1869324939721856:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782727317.860279:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fd11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+18:8852:x1869324939721856:12345-0@lo:502:llog_process_th.0 Request processed in 63us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727317.860286:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1782727317.860316:0:8852:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c5d111b40 going to sleep for 11 seconds 00000100:00100000:0.0:1782727317.860328:0:8852:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7df62d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c71e9f0f-6441-4b9b-bc96-153ab9250801:8852:1869324939721856:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782727317.860347:0:8852:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782727317.860354:0:8852:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782727317.860357:0:8852:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1782727317.860362:0:8852:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1782727317.860381:0:8852:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7df62d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c71e9f0f-6441-4b9b-bc96-153ab9250801:8852:1869324939721984:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782727317.860412:0:8852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727317.860430:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939721984 00000100:00100000:0.0:1782727317.860433:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939721984 00000100:00100000:0.0:1782727317.860449:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1782727317.860454:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6dd3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+18:8852:x1869324939721984:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782727317.860509:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6dd3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+18:8852:x1869324939721984:12345-0@lo:502:llog_process_th.0 Request processed in 54us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727317.860515:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1782727317.860543:0:8852:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c5d111b40 going to sleep for 11 seconds 00000100:00100000:0.0:1782727317.860559:0:8852:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7df62d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c71e9f0f-6441-4b9b-bc96-153ab9250801:8852:1869324939721984:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782727317.860577:0:8852:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782727317.860581:0:8852:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782727317.860582:0:8852:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1782727317.860585:0:8852:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1782727317.860626:0:5946:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1782727317.860643:0:5946:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1782727317.860651:0:5946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff921c7a3e0400/0x14a47870ee88cc14 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88cc1b expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727317.860660:0:5946:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff921c7a3e0400/0x14a47870ee88cc14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88cc1b expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782727317.860669:0:5946:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1782727317.860671:0:5946:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff921c519f0000 from 1 10000000:01000000:0.0:1782727317.860673:0:5946:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1782727317.860693:0:5946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff921c7a3e1400/0x14a47870ee88cc22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727317.860701:0:5946:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff921c7a3e1400/0x14a47870ee88cc22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727317.860710:0:5946:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff921c7a3e1400/0x14a47870ee88cc22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727317.860723:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7df62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939722112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782727317.860747:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727317.860761:0:5946:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c5d111b40 going to sleep for 11 seconds 00000100:00100000:0.0:1782727317.860772:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939722112 00000100:00100000:0.0:1782727317.860775:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939722112 00000100:00100000:0.0:1782727317.860799:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1782727317.860805:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6dd3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+18:5946:x1869324939722112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782727317.860812:0:5943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727317.860822:0:5943:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921c7a3e0000/0x14a47870ee88cc29 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x14a47870ee88cc22 expref: -99 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727317.860839:0:5943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921c7a3e0000/0x14a47870ee88cc29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x14a47870ee88cc22 expref: 19 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727317.860849:0:5943:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921c7a3e0000/0x14a47870ee88cc29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x14a47870ee88cc22 expref: 19 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727317.860857:0:5943:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c7a3e0000, rc 0) 00000100:00100000:0.0:1782727317.860909:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6dd3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:5946:x1869324939722112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727317.860916:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1782727317.860945:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7df62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939722112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782727317.860956:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff921c7a3e1400/0x14a47870ee88cc22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88cc29 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727317.860964:0:5946:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff921c7a3e1400/0x14a47870ee88cc22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x14a47870ee88cc29 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727317.861001:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7df62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939722240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782727317.862598:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727317.862647:0:5946:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c5d111b40 going to sleep for 11 seconds 00000100:00100000:2.0:1782727317.862695:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939722240 00000100:00100000:2.0:1782727317.862702:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939722240 00000100:00100000:2.0:1782727317.862748:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1782727317.862756:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6dd3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:5946:x1869324939722240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782727317.862857:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6dd3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:5946:x1869324939722240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 102us (263us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782727317.862864:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1782727317.863060:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7df62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939722240:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1782727317.863109:0:5946:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1782727317.863117:0:5946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff921c7a3e1400/0x14a47870ee88cc22 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88cc29 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727317.863126:0:5946:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff921c7a3e1400/0x14a47870ee88cc22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88cc29 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727317.892776:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1782727317.892938:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914529152 00000100:00100000:1.0:1782727317.892949:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914529152 00000100:00100000:1.0:1782727317.893011:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 165 00000100:00100000:1.0:1782727317.893031:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6dd3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecaf1fda-ff42-4054-9f39-8e142296107b+8:5458:x1869324914529152:12345-192.168.202.60@tcp:101: 00010000:00010000:1.0:1782727317.893064:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727317.893083:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921c43a23400/0x14a47870ee88cc30 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x1752a87bbfbdf09d expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727317.893115:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921c43a23400/0x14a47870ee88cc30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf09d expref: 9 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727317.893126:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921c43a23400/0x14a47870ee88cc30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf09d expref: 9 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727317.893136:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c43a23400, rc 0) 00000100:00100000:1.0:1782727317.893201:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6dd3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecaf1fda-ff42-4054-9f39-8e142296107b+9:5458:x1869324914529152:12345-192.168.202.60@tcp:101: Request processed in 181us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727317.893207:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 165 00000100:00100000:2.0:1782727317.897419:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1782727317.897510:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914529280 00000100:00100000:3.0:1782727317.897520:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914529280 00000100:00100000:3.0:1782727317.897580:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 166 00000100:00100000:3.0:1782727317.897592:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6dd3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecaf1fda-ff42-4054-9f39-8e142296107b+9:5458:x1869324914529280:12345-192.168.202.60@tcp:501: 00000100:00100000:3.0:1782727317.897751:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6dd3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecaf1fda-ff42-4054-9f39-8e142296107b+9:5458:x1869324914529280:12345-192.168.202.60@tcp:501: Request processed in 161us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727317.897759:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 166 00000100:00100000:3.0:1782727317.900559:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1782727317.900747:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914529408 00000100:00100000:2.0:1782727317.900757:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914529408 00000100:00100000:2.0:1782727317.900810:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 167 00000100:00100000:2.0:1782727317.900821:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6dd3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecaf1fda-ff42-4054-9f39-8e142296107b+9:5458:x1869324914529408:12345-192.168.202.60@tcp:503: 00000100:00100000:2.0:1782727317.900983:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6dd3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecaf1fda-ff42-4054-9f39-8e142296107b+9:5458:x1869324914529408:12345-192.168.202.60@tcp:503: Request processed in 163us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727317.901001:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 167 00000100:00100000:0.0:1782727317.932190:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1782727317.935150:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914529536 00000100:00100000:1.0:1782727317.935166:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914529536 00000100:00100000:1.0:1782727317.935241:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 168 00000100:00100000:1.0:1782727317.935252:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6dd3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecaf1fda-ff42-4054-9f39-8e142296107b+9:5930:x1869324914529536:12345-192.168.202.60@tcp:502: 00000100:00100000:1.0:1782727317.935430:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6dd3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecaf1fda-ff42-4054-9f39-8e142296107b+9:5930:x1869324914529536:12345-192.168.202.60@tcp:502: Request processed in 178us (3251us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727317.935439:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 168 00010000:00010000:3.0:1782727317.945037:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727317.949825:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1782727317.949927:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914529664 00000100:00100000:3.0:1782727317.949938:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914529664 00000100:00100000:3.0:1782727317.950011:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 169 00000100:00100000:3.0:1782727317.950034:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6dd3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecaf1fda-ff42-4054-9f39-8e142296107b+9:5930:x1869324914529664:12345-192.168.202.60@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782727317.950351:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6dd3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecaf1fda-ff42-4054-9f39-8e142296107b+9:5930:x1869324914529664:12345-192.168.202.60@tcp:502:llog_process_th.0 Request processed in 329us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727317.950368:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 169 00000100:00100000:3.0:1782727317.962161:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1782727317.962587:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914529792 00000100:00100000:2.0:1782727317.962597:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914529792 00000100:00100000:2.0:1782727317.962727:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 170 00000100:00100000:2.0:1782727317.962739:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6dd3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecaf1fda-ff42-4054-9f39-8e142296107b+9:5458:x1869324914529792:12345-192.168.202.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782727317.962756:0:5943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727317.962773:0:5943:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921c429d5e00/0x14a47870ee88cc37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x1752a87bbfbdf0a4 expref: -99 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727317.962801:0:5943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921c429d5e00/0x14a47870ee88cc37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf0a4 expref: 10 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727317.962811:0:5943:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921c429d5e00/0x14a47870ee88cc37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf0a4 expref: 10 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727317.962820:0:5943:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c429d5e00, rc 0) 00000100:00100000:2.0:1782727317.962913:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6dd3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecaf1fda-ff42-4054-9f39-8e142296107b+10:5458:x1869324914529792:12345-192.168.202.60@tcp:101:ll_cfg_requeue.0 Request processed in 145us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727317.962922:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 170 00000100:00100000:1.0:1782727317.967414:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1782727317.967706:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914529920 00000100:00100000:2.0:1782727317.967716:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914529920 00000100:00100000:2.0:1782727317.967774:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 171 00000100:00100000:2.0:1782727317.967784:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6dd3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecaf1fda-ff42-4054-9f39-8e142296107b+10:5458:x1869324914529920:12345-192.168.202.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782727317.968006:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6dd3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecaf1fda-ff42-4054-9f39-8e142296107b+10:5458:x1869324914529920:12345-192.168.202.60@tcp:501:ll_cfg_requeue.0 Request processed in 222us (614us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782727317.968015:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 171 00010000:00010000:3.0:1782727318.969997:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782727318.975462:0:8889:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd16df1e70 20000000:00000080:0.0:1782727318.975479:0:8889:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff921c80618c00 uarg=0000000000000000 20000000:01000000:0.0:1782727318.975532:0:8889:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1782727318.975538:0:8889:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1782727318.975542:0:8889:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1782727318.977765:0:8890:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1782727318.978049:0:8889:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1782727318.987705:0:8889:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1782727318.987740:0:8889:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1782727318.987756:0:8889:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1782727318.987774:0:8889:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1782727318.987794:0:8889:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff921c7a3e1200/0x14a47870ee88cc3e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727318.987812:0:8889:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff921c4151ce00/0x14a47870ee88c9b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x14a47870ee88c9ac expref: 18 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727318.987822:0:8889:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff921c4151cc00/0x14a47870ee88ca15 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x14a47870ee88ca0e expref: 18 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727318.987829:0:8889:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff921c429d4800/0x14a47870ee88cae0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x14a47870ee88cad9 expref: 18 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727318.987853:0:8889:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff921c4151c800/0x14a47870ee88cb9d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf06c expref: 9 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727318.987861:0:8889:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff921c7a3e1200/0x14a47870ee88cc3e lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727318.987994:0:8889:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff921c4151c800/0x14a47870ee88cb9d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf06c expref: 9 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727318.988017:0:8889:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff921c4151c800/0x14a47870ee88cb9d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf06c expref: 9 pid: 5944 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727318.988032:0:8889:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7df62d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8889:1869324939722368:192.168.202.60@tcp:104: 00010000:00010000:0.0:1782727318.988144:0:8889:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff921c429d4800/0x14a47870ee88cae0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x14a47870ee88cad9 expref: 18 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727318.988152:0:8889:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff921c429d4800/0x14a47870ee88cae0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x14a47870ee88cad9 expref: 18 pid: 5944 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727318.988161:0:8889:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7df60380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8889:1869324939722496:0@lo:104: 00000100:00100000:0.0:1782727318.988201:0:8889:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782727318.988237:0:8889:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff921c4151cc00/0x14a47870ee88ca15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x14a47870ee88ca0e expref: 18 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727318.988257:0:8889:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff921c4151cc00/0x14a47870ee88ca15 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x14a47870ee88ca0e expref: 18 pid: 5943 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727318.988265:0:8889:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7df61f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8889:1869324939722624:0@lo:104: 00000100:00100000:0.0:1782727318.988301:0:8889:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782727318.988321:0:8889:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff921c4151ce00/0x14a47870ee88c9b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x14a47870ee88c9ac expref: 18 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727318.988329:0:8889:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff921c4151ce00/0x14a47870ee88c9b3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x14a47870ee88c9ac expref: 18 pid: 5942 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727318.988334:0:8889:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7df61c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8889:1869324939722752:0@lo:104: 00000100:00100000:0.0:1782727318.988346:0:8889:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c5d111240 going to sleep for 11 seconds 00000100:00100000:0.0:1782727318.989114:0:5932:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1782727318.989137:0:5932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727318.989147:0:5932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939722496 00000100:00100000:0.0:1782727318.989154:0:5932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939722496 00000100:00100000:0.0:1782727318.989191:0:5932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939722624 00000100:00100000:0.0:1782727318.989194:0:5932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939722624 00000100:00100000:0.0:1782727318.989205:0:5932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939722752 00000100:00100000:0.0:1782727318.989208:0:5932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939722752 00000100:00100000:0.0:1782727318.989220:0:5932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1782727318.989227:0:5932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7df63100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c71e9f0f-6441-4b9b-bc96-153ab9250801+5:8889:x1869324939722496:12345-0@lo:104: 00010000:00010000:0.0:1782727318.989242:0:5932:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.160@tcp lock: ffff921c4151c200/0x14a47870ee88cad9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x14a47870ee88cae0 expref: -99 pid: 8017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727318.989304:0:5932:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782727318.989310:0:5932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7df63100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c71e9f0f-6441-4b9b-bc96-153ab9250801+5:8889:x1869324939722496:12345-0@lo:104: Request processed in 83us (1109us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727318.989317:0:5932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1782727318.989334:0:5932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1782727318.989340:0:5932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7deb1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c71e9f0f-6441-4b9b-bc96-153ab9250801+4:8889:x1869324939722624:12345-0@lo:104: 00010000:00010000:0.0:1782727318.989347:0:5932:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.160@tcp lock: ffff921c43a22a00/0x14a47870ee88ca0e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x14a47870ee88ca15 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727318.989353:0:8889:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7df60380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8889:1869324939722496:0@lo:104: 00010000:00010000:2.0:1782727318.989373:0:8027:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782727318.989379:0:8027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff921c4151c200/0x14a47870ee88cad9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x14a47870ee88cae0 expref: -99 pid: 8017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727318.989388:0:5932:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782727318.989393:0:5932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7deb1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c71e9f0f-6441-4b9b-bc96-153ab9250801+4:8889:x1869324939722624:12345-0@lo:104: Request processed in 54us (1092us total) trans 0 rc 0/0 00010000:00010000:2.0:1782727318.989398:0:8027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c4151c200 already unused, calling callback (ffffffffc12b0c20) 00000100:00100000:0.0:1782727318.989399:0:5932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 10000000:00010000:2.0:1782727318.989402:0:8027:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff921c4151c200/0x14a47870ee88cad9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x14a47870ee88cae0 expref: -99 pid: 8017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727318.989410:0:8027:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff921c4151c200/0x14a47870ee88cad9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x14a47870ee88cae0 expref: -99 pid: 8017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782727318.989417:0:8027:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff921c4151c200/0x14a47870ee88cad9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x14a47870ee88cae0 expref: -99 pid: 8017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782727318.989422:0:8027:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1782727318.989457:0:5932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1782727318.989464:0:5932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7df60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c71e9f0f-6441-4b9b-bc96-153ab9250801+3:8889:x1869324939722752:12345-0@lo:104: 00010000:00010000:0.0:1782727318.989471:0:5932:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.160@tcp lock: ffff921c4151da00/0x14a47870ee88c9ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x14a47870ee88c9b3 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727318.989511:0:8027:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff921c4151c200/0x14a47870ee88cad9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x14a47870ee88cae0 expref: -99 pid: 8017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727318.989513:0:5932:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:2.0:1782727318.989519:0:8027:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1782727318.989523:0:5932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7df60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c71e9f0f-6441-4b9b-bc96-153ab9250801+3:8889:x1869324939722752:12345-0@lo:104: Request processed in 61us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727318.989529:0:5932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1782727318.989536:0:8027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff921c4151c200/0x14a47870ee88cad9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x14a47870ee88cae0 expref: -99 pid: 8017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727318.989543:0:8027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff921c4151c200/0x14a47870ee88cad9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x14a47870ee88cae0 expref: -99 pid: 8017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727318.989554:0:8027:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782727318.989557:0:8027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff921c43a22a00/0x14a47870ee88ca0e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x14a47870ee88ca15 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727318.989563:0:8027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c43a22a00 already unused, calling callback (ffffffffc12b0c20) 10000000:00010000:2.0:1782727318.989566:0:8027:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff921c43a22a00/0x14a47870ee88ca0e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x14a47870ee88ca15 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727318.989582:0:8027:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff921c43a22a00/0x14a47870ee88ca0e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x14a47870ee88ca15 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782727318.989589:0:8027:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff921c43a22a00/0x14a47870ee88ca0e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x14a47870ee88ca15 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782727318.989594:0:8027:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1782727318.989664:0:8027:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff921c43a22a00/0x14a47870ee88ca0e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x14a47870ee88ca15 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727318.989670:0:8027:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782727318.989676:0:8027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff921c43a22a00/0x14a47870ee88ca0e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x14a47870ee88ca15 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727318.989683:0:8027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff921c43a22a00/0x14a47870ee88ca0e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x14a47870ee88ca15 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727318.989693:0:8027:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782727318.989696:0:8027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff921c4151da00/0x14a47870ee88c9ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x14a47870ee88c9b3 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727318.989698:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7d6ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c71e9f0f-6441-4b9b-bc96-153ab9250801:3444:1869324939722880:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782727318.989701:0:8027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c4151da00 already unused, calling callback (ffffffffc12b0c20) 10000000:00010000:2.0:1782727318.989704:0:8027:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff921c4151da00/0x14a47870ee88c9ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x14a47870ee88c9b3 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727318.989710:0:8027:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff921c4151da00/0x14a47870ee88c9ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x14a47870ee88c9b3 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782727318.989716:0:8027:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff921c4151da00/0x14a47870ee88c9ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x14a47870ee88c9b3 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782727318.989726:0:8027:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1782727318.989730:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727318.989765:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782727318.989771:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7d6e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c71e9f0f-6441-4b9b-bc96-153ab9250801:3444:1869324939723008:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782727318.989798:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727318.989824:0:5935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939722880 00000100:00100000:1.0:1782727318.989828:0:5935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939722880 00010000:00010000:1.0:1782727318.989847:0:5935:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff921c429d4800/0x14a47870ee88cae0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x14a47870ee88cad9 expref: 19 pid: 5944 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727318.989865:0:5935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939723008 00000100:00100000:1.0:1782727318.989868:0:5935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939723008 00010000:00010000:1.0:1782727318.989878:0:5935:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff921c4151cc00/0x14a47870ee88ca15 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x14a47870ee88ca0e expref: 20 pid: 5943 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727318.989913:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1782727318.989919:0:5935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dfc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c71e9f0f-6441-4b9b-bc96-153ab9250801+20:3444:x1869324939722880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782727318.989929:0:5935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782727318.989933:0:5935:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff921c429d4800/0x14a47870ee88cae0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x14a47870ee88cad9 expref: 20 pid: 5944 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727318.989941:0:5935:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff921c429d4800/0x14a47870ee88cae0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x14a47870ee88cad9 expref: 20 pid: 5944 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727318.989954:0:5935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921c429d4800/0x14a47870ee88cae0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x14a47870ee88cad9 expref: 20 pid: 5944 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727318.989966:0:5935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782727318.989992:0:5935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dfc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:3444:x1869324939722880:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727318.989997:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1782727318.990024:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1782727318.990031:0:5935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dfc3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c71e9f0f-6441-4b9b-bc96-153ab9250801+18:3444:x1869324939723008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782727318.990046:0:5935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782727318.990051:0:5935:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff921c4151cc00/0x14a47870ee88ca15 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x14a47870ee88ca0e expref: 18 pid: 5943 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727318.990058:0:5935:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff921c4151cc00/0x14a47870ee88ca15 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x14a47870ee88ca0e expref: 18 pid: 5943 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727318.990067:0:5935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782727318.990088:0:5935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dfc3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c71e9f0f-6441-4b9b-bc96-153ab9250801+18:3444:x1869324939723008:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727318.990094:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1782727318.990121:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7d6e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c71e9f0f-6441-4b9b-bc96-153ab9250801:3444:1869324939723008:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782727318.990130:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7d6ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c71e9f0f-6441-4b9b-bc96-153ab9250801:3444:1869324939722880:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782727318.991337:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727318.991355:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727318.993842:0:8027:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff921c4151da00/0x14a47870ee88c9ac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x14a47870ee88c9b3 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727318.993861:0:8027:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782727318.993904:0:8027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff921c4151da00/0x14a47870ee88c9ac lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x14a47870ee88c9b3 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727318.993913:0:8027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff921c4151da00/0x14a47870ee88c9ac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x14a47870ee88c9b3 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727318.993932:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727318.993935:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727318.994087:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727318.994108:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7d6eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c71e9f0f-6441-4b9b-bc96-153ab9250801:3442:1869324939723136:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782727318.994179:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782727318.994427:0:8889:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921c4151cc00/0x14a47870ee88ca15 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x14a47870ee88ca0e expref: 17 pid: 5943 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727318.994441:0:8889:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7df61f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8889:1869324939722624:0@lo:104: 00000100:00100000:3.0:1782727318.994539:0:5935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939723136 00000100:00100000:3.0:1782727318.994547:0:5935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939723136 00010000:00010000:3.0:1782727318.994578:0:5935:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff921c4151ce00/0x14a47870ee88c9b3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x14a47870ee88c9ac expref: 17 pid: 5942 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727318.994618:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1782727318.994628:0:5935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7d6e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c71e9f0f-6441-4b9b-bc96-153ab9250801+17:3442:x1869324939723136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782727318.994642:0:5935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782727318.994647:0:5935:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff921c4151ce00/0x14a47870ee88c9b3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x14a47870ee88c9ac expref: 17 pid: 5942 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727318.994657:0:5935:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff921c4151ce00/0x14a47870ee88c9b3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x14a47870ee88c9ac expref: 17 pid: 5942 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727318.994674:0:5935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782727318.994718:0:5935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7d6e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c71e9f0f-6441-4b9b-bc96-153ab9250801+17:3442:x1869324939723136:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727318.994726:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1782727318.994754:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7d6eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c71e9f0f-6441-4b9b-bc96-153ab9250801:3442:1869324939723136:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782727318.994842:0:8889:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921c4151ce00/0x14a47870ee88c9b3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x14a47870ee88c9ac expref: 16 pid: 5942 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727318.994852:0:8889:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7df61c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8889:1869324939722752:0@lo:104: 00000100:00100000:1.0:1782727319.003117:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1782727319.003170:0:5936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914530048 00000100:00100000:0.0:1782727319.003183:0:5936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914530048 00010000:00010000:0.0:1782727319.003255:0:5936:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff921c4151c800/0x14a47870ee88cb9d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf06c expref: 10 pid: 5944 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727319.003261:0:8889:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7df62d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8889:1869324939722368:192.168.202.60@tcp:104: 00010000:00010000:3.0:1782727319.003312:0:8889:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff921c7a3e1200/0x14a47870ee88cc3e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727319.003318:0:5936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 24 00000100:00100000:0.0:1782727319.003328:0:5936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dfc0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ecaf1fda-ff42-4054-9f39-8e142296107b+10:2357:x1869324914530048:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782727319.003342:0:5936:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782727319.003347:0:5936:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff921c4151c800/0x14a47870ee88cb9d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf06c expref: 10 pid: 5944 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727319.003358:0:5936:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff921c4151c800/0x14a47870ee88cb9d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf06c expref: 10 pid: 5944 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727319.003385:0:5936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921c4151c800/0x14a47870ee88cb9d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf06c expref: 10 pid: 5944 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727319.003399:0:5936:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff921c7a3e1200/0x14a47870ee88cc3e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727319.003407:0:5936:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921c7a3e1200/0x14a47870ee88cc3e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727319.003421:0:5936:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff921c7a3e1200/0x14a47870ee88cc3e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727319.003428:0:5936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff921c7a3e1200/0x14a47870ee88cc3e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727319.003435:0:5936:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff921c7a3e1200/0x14a47870ee88cc3e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727319.003441:0:5936:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff921c7a3e1200/0x14a47870ee88cc3e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727319.003458:0:5936:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c7a3e1200 already unused, calling callback (ffffffffc0c98cf0) 00010000:00010000:0.0:1782727319.003462:0:5936:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff921c7a3e1200/0x14a47870ee88cc3e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727319.003469:0:5936:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff921c7a3e1200/0x14a47870ee88cc3e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727319.003488:0:5936:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff921c7a3e1200/0x14a47870ee88cc3e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727319.003507:0:5936:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782727319.003557:0:5936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dfc0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ecaf1fda-ff42-4054-9f39-8e142296107b+9:2357:x1869324914530048:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 229us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727319.003565:0:5936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 24 00010000:00010000:3.0:1782727319.003619:0:8889:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff921c7a3e1200/0x14a47870ee88cc3e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727319.003626:0:8889:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff921c7a3e1200/0x14a47870ee88cc3e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727319.003632:0:8889:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921c7a3e1200/0x14a47870ee88cc3e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727319.322374:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1782727319.322476:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914530176 00000100:00100000:0.0:1782727319.322486:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914530176 00000100:00100000:0.0:1782727319.322554:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 172 00000100:00100000:0.0:1782727319.322565:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6dd3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecaf1fda-ff42-4054-9f39-8e142296107b+9:5458:x1869324914530176:12345-192.168.202.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782727319.322582:0:5943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727319.322601:0:5943:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921c7a3e1000/0x14a47870ee88cc45 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1752a87bbfbdf0ab expref: -99 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727319.322631:0:5943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921c7a3e1000/0x14a47870ee88cc45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf0ab expref: 10 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727319.322643:0:5943:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921c7a3e1000/0x14a47870ee88cc45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf0ab expref: 10 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727319.322651:0:5943:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c7a3e1000, rc 0) 00000100:00100000:0.0:1782727319.322712:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6dd3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecaf1fda-ff42-4054-9f39-8e142296107b+10:5458:x1869324914530176:12345-192.168.202.60@tcp:101:ll_cfg_requeue.0 Request processed in 148us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727319.322719:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 172 00000100:00100000:1.0:1782727319.339422:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1782727319.339530:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914530304 00000100:00100000:2.0:1782727319.339539:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914530304 00000100:00100000:2.0:1782727319.339598:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 173 00000100:00100000:2.0:1782727319.339622:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6dd3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecaf1fda-ff42-4054-9f39-8e142296107b+10:5458:x1869324914530304:12345-192.168.202.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782727319.339803:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6dd3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecaf1fda-ff42-4054-9f39-8e142296107b+10:5458:x1869324914530304:12345-192.168.202.60@tcp:501:ll_cfg_requeue.0 Request processed in 184us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727319.339811:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 173 00000100:00100000:3.0:1782727319.344612:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1782727319.344721:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914530432 00000100:00100000:1.0:1782727319.344730:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914530432 00000100:00100000:1.0:1782727319.344787:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 174 00000100:00100000:1.0:1782727319.344796:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6dd3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecaf1fda-ff42-4054-9f39-8e142296107b+10:5458:x1869324914530432:12345-192.168.202.60@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782727319.344966:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6dd3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecaf1fda-ff42-4054-9f39-8e142296107b+10:5458:x1869324914530432:12345-192.168.202.60@tcp:503:ll_cfg_requeue.0 Request processed in 170us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727319.344973:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 174 00000100:00100000:3.0:1782727319.353748:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1782727319.353853:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914530560 00000100:00100000:0.0:1782727319.353863:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914530560 00000100:00100000:0.0:1782727319.353945:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 175 00000100:00100000:0.0:1782727319.353955:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6dd3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecaf1fda-ff42-4054-9f39-8e142296107b+10:5971:x1869324914530560:12345-192.168.202.60@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782727319.354124:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6dd3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecaf1fda-ff42-4054-9f39-8e142296107b+10:5971:x1869324914530560:12345-192.168.202.60@tcp:502:llog_process_th.0 Request processed in 169us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727319.354131:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 175 00000100:00100000:3.0:1782727319.362834:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1782727319.362957:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914530688 00000100:00100000:2.0:1782727319.362967:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914530688 00000100:00100000:2.0:1782727319.363090:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 176 00000100:00100000:2.0:1782727319.363100:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6dd3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecaf1fda-ff42-4054-9f39-8e142296107b+10:5971:x1869324914530688:12345-192.168.202.60@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782727319.363246:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6dd3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecaf1fda-ff42-4054-9f39-8e142296107b+10:5971:x1869324914530688:12345-192.168.202.60@tcp:502:llog_process_th.0 Request processed in 147us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727319.363254:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 176 00010000:00010000:3.0:1782727319.993023:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782727320.697045:0:5946:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1782727320.697054:0:5946:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff921c7d8c0800 from 4 10000000:01000000:0.0:1782727320.697059:0:5946:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1782727320.697108:0:5946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff921c7a3e0e00/0x14a47870ee88cc4c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727320.697120:0:5946:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff921c7a3e0e00/0x14a47870ee88cc4c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727320.697132:0:5946:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff921c7a3e0e00/0x14a47870ee88cc4c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727320.697156:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7df63100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939723264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782727320.697239:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727320.697401:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939723264 00000100:00100000:1.0:1782727320.697408:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939723264 00000100:00100000:1.0:1782727320.697457:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1782727320.697466:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6dd3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+16:5946:x1869324939723264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782727320.697504:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727320.697516:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921c43a22400/0x14a47870ee88cc53 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x14a47870ee88cc4c expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727320.697538:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921c43a22400/0x14a47870ee88cc53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x14a47870ee88cc4c expref: 17 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727320.697548:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921c43a22400/0x14a47870ee88cc53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x14a47870ee88cc4c expref: 17 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727320.697556:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c43a22400, rc 0) 00000100:00100000:1.0:1782727320.697586:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6dd3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+17:5946:x1869324939723264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727320.697592:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1782727320.697671:0:5946:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c7d81f540 going to sleep for 11 seconds 00000100:00100000:0.0:1782727320.697694:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7df63100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939723264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782727320.697707:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff921c7a3e0e00/0x14a47870ee88cc4c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88cc53 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727320.697715:0:5946:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff921c7a3e0e00/0x14a47870ee88cc4c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x14a47870ee88cc53 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727320.697772:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7df63100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939723392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782727320.697796:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727320.697832:0:5946:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c7d81f540 going to sleep for 11 seconds 00000100:00100000:2.0:1782727320.698313:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939723392 00000100:00100000:2.0:1782727320.698319:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939723392 00000100:00100000:2.0:1782727320.698357:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1782727320.698365:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5d073c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+17:5946:x1869324939723392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782727320.698625:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5d073c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+17:5946:x1869324939723392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 260us (827us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727320.698632:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1782727320.698761:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7df63100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939723392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782727320.698798:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7dffaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939723520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782727320.699652:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727320.699724:0:5946:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c765a73c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782727320.699765:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939723520 00000100:00100000:0.0:1782727320.699771:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939723520 00000100:00100000:0.0:1782727320.699960:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1782727320.699970:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5d072850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+17:5946:x1869324939723520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782727320.700117:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5d072850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+17:5946:x1869324939723520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 148us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727320.700123:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1782727320.701221:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7dffaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939723520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782727320.701873:0:8957:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7d6e9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c71e9f0f-6441-4b9b-bc96-153ab9250801:8957:1869324939723648:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782727320.702096:0:8957:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727320.702127:0:8957:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c52211900 going to sleep for 11 seconds 00000100:00100000:1.0:1782727320.702187:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939723648 00000100:00100000:1.0:1782727320.702193:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939723648 00000100:00100000:1.0:1782727320.702306:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1782727320.702315:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5d070450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+17:8957:x1869324939723648:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782727320.702481:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5d070450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+17:8957:x1869324939723648:12345-0@lo:502:llog_process_th.0 Request processed in 156us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727320.702489:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1782727320.707846:0:8957:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7d6e9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c71e9f0f-6441-4b9b-bc96-153ab9250801:8957:1869324939723648:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782727320.708614:0:8957:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782727320.708625:0:8957:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782727320.708627:0:8957:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1782727320.708634:0:8957:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff921c7d8c0800 00000020:00000080:0.0:1782727320.708636:0:8957:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1782727320.708724:0:8957:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7df63480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c71e9f0f-6441-4b9b-bc96-153ab9250801:8957:1869324939723776:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782727320.708811:0:8957:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727320.708857:0:8957:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c7d81f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782727320.709191:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939723776 00000100:00100000:2.0:1782727320.709215:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939723776 00000100:00100000:2.0:1782727320.709273:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1782727320.709282:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5d070850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+17:8957:x1869324939723776:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782727320.709397:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5d070850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+17:8957:x1869324939723776:12345-0@lo:502:llog_process_th.0 Request processed in 116us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727320.709405:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1782727320.713642:0:8957:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7df63480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c71e9f0f-6441-4b9b-bc96-153ab9250801:8957:1869324939723776:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782727320.713685:0:8957:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782727320.713694:0:8957:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782727320.713696:0:8957:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1782727320.713700:0:8957:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1782727320.717344:0:5946:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1782727320.717386:0:5946:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782727320.717399:0:5946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff921c7a3e0e00/0x14a47870ee88cc4c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88cc53 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727320.717412:0:5946:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff921c7a3e0e00/0x14a47870ee88cc4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88cc53 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782727320.717423:0:5946:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1782727320.717425:0:5946:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff921c45e6f800 from 4 10000000:01000000:2.0:1782727320.717428:0:5946:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782727320.717466:0:5946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff921c429d4600/0x14a47870ee88cc5a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727320.717489:0:5946:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff921c429d4600/0x14a47870ee88cc5a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727320.717500:0:5946:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff921c429d4600/0x14a47870ee88cc5a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727320.717524:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7d6e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939723904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782727320.717588:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727320.717628:0:5946:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c52211cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782727320.717661:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939723904 00000100:00100000:2.0:1782727320.717674:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939723904 00000100:00100000:2.0:1782727320.717718:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1782727320.717728:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6e0fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+17:5946:x1869324939723904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782727320.717741:0:5943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727320.717752:0:5943:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921c429d4800/0x14a47870ee88cc61 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x14a47870ee88cc5a expref: -99 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727320.717775:0:5943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921c429d4800/0x14a47870ee88cc61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x14a47870ee88cc5a expref: 18 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727320.717785:0:5943:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921c429d4800/0x14a47870ee88cc61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x14a47870ee88cc5a expref: 18 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727320.717794:0:5943:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c429d4800, rc 0) 00000100:00100000:2.0:1782727320.717839:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6e0fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+18:5946:x1869324939723904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727320.717846:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1782727320.717914:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7d6e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939723904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782727320.717928:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff921c429d4600/0x14a47870ee88cc5a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88cc61 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727320.719300:0:5946:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff921c429d4600/0x14a47870ee88cc5a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x14a47870ee88cc61 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727320.719385:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7d6e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939724032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782727320.719430:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727320.719468:0:5946:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c52211cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782727320.719929:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939724032 00000100:00100000:3.0:1782727320.720087:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939724032 00000100:00100000:3.0:1782727320.720132:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1782727320.720140:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6e0fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+18:5946:x1869324939724032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782727320.720262:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6e0fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+18:5946:x1869324939724032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 122us (831us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727320.720268:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1782727320.720933:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7d6e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939724032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782727320.721301:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7d6e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939724160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782727320.721355:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727320.721383:0:5946:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c52211cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782727320.721402:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939724160 00000100:00100000:2.0:1782727320.721407:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939724160 00000100:00100000:2.0:1782727320.721437:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1782727320.721443:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6e0fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+18:5946:x1869324939724160:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782727320.722683:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6e0fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+18:5946:x1869324939724160:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1235us (1322us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727320.722692:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1782727320.722852:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7d6e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939724160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782727320.728677:0:8959:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7dffb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c71e9f0f-6441-4b9b-bc96-153ab9250801:8959:1869324939724288:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782727320.728755:0:8959:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727320.728789:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939724288 00000100:00100000:3.0:1782727320.728795:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939724288 00000100:00100000:3.0:1782727320.728836:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1782727320.728845:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6e0ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+18:8959:x1869324939724288:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782727320.728976:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6e0ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+18:8959:x1869324939724288:12345-0@lo:502:llog_process_th.0 Request processed in 130us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727320.728983:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1782727320.729038:0:8959:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c7d6c1900 going to sleep for 11 seconds 00000100:00100000:3.0:1782727320.729060:0:8959:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7dffb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c71e9f0f-6441-4b9b-bc96-153ab9250801:8959:1869324939724288:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782727320.729085:0:8959:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782727320.729094:0:8959:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782727320.729096:0:8959:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1782727320.729102:0:8959:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff921c45e6f800 00000020:00000080:3.0:1782727320.729104:0:8959:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1782727320.729180:0:8959:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7dffb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c71e9f0f-6441-4b9b-bc96-153ab9250801:8959:1869324939724416:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782727320.729208:0:8959:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727320.729219:0:8959:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c7d6c1900 going to sleep for 11 seconds 00000100:00100000:2.0:1782727320.729624:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939724416 00000100:00100000:2.0:1782727320.729629:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939724416 00000100:00100000:2.0:1782727320.729664:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1782727320.729671:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6e0ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+18:8959:x1869324939724416:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782727320.729736:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6e0ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+18:8959:x1869324939724416:12345-0@lo:502:llog_process_th.0 Request processed in 66us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727320.729742:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1782727320.733218:0:8959:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7dffb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c71e9f0f-6441-4b9b-bc96-153ab9250801:8959:1869324939724416:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782727320.733260:0:8959:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782727320.733268:0:8959:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782727320.733270:0:8959:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1782727320.733274:0:8959:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1782727320.733348:0:5946:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1782727320.733367:0:5946:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782727320.733378:0:5946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff921c429d4600/0x14a47870ee88cc5a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88cc61 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727320.733415:0:5946:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff921c429d4600/0x14a47870ee88cc5a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88cc61 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727320.733427:0:5946:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1782727320.733429:0:5946:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff921c479c5800 from 4 10000000:01000000:3.0:1782727320.733432:0:5946:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782727320.733464:0:5946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff921c4151d200/0x14a47870ee88cc68 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727320.733483:0:5946:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff921c4151d200/0x14a47870ee88cc68 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727320.733492:0:5946:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff921c4151d200/0x14a47870ee88cc68 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727320.733513:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7dffb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939724544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782727320.733574:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727320.733616:0:5946:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c7d6c1900 going to sleep for 11 seconds 00000100:00100000:1.0:1782727320.737063:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939724544 00000100:00100000:1.0:1782727320.737078:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939724544 00000100:00100000:1.0:1782727320.737140:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1782727320.737150:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6e0fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+18:5946:x1869324939724544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782727320.737167:0:5943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727320.737184:0:5943:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921c43a22e00/0x14a47870ee88cc6f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x14a47870ee88cc68 expref: -99 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727320.737222:0:5943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921c43a22e00/0x14a47870ee88cc6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x14a47870ee88cc68 expref: 19 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727320.737233:0:5943:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921c43a22e00/0x14a47870ee88cc6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x14a47870ee88cc68 expref: 19 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727320.737243:0:5943:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c43a22e00, rc 0) 00000100:00100000:1.0:1782727320.737318:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6e0fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:5946:x1869324939724544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (3744us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727320.737325:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1782727320.741270:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7dffb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939724544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782727320.741302:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff921c4151d200/0x14a47870ee88cc68 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88cc6f expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727320.741316:0:5946:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff921c4151d200/0x14a47870ee88cc68 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x14a47870ee88cc6f expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727320.741423:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7df63480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939724672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782727320.742735:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727320.742787:0:5946:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c7d81f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782727320.743616:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939724672 00000100:00100000:3.0:1782727320.743626:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939724672 00000100:00100000:3.0:1782727320.743675:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1782727320.743684:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6e0ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:5946:x1869324939724672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782727320.743824:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6e0ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:5946:x1869324939724672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 140us (1093us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727320.743832:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1782727320.746284:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7df63480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939724672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782727320.746332:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7dfc2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939724800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782727320.746392:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727320.746454:0:5946:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c42de4a80 going to sleep for 11 seconds 00000100:00100000:3.0:1782727320.747385:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939724800 00000100:00100000:3.0:1782727320.747394:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939724800 00000100:00100000:2.0:1782727320.747577:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1782727320.747587:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6e0fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:5946:x1869324939724800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782727320.747728:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6e0fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:5946:x1869324939724800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 138us (1330us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727320.747736:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1782727320.748046:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7dfc2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939724800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782727320.749503:0:8961:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7df60000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c71e9f0f-6441-4b9b-bc96-153ab9250801:8961:1869324939724928:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782727320.749569:0:8961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727320.749640:0:8961:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c7d81ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1782727320.749676:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939724928 00000100:00100000:3.0:1782727320.749688:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939724928 00000100:00100000:3.0:1782727320.749772:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1782727320.749782:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6e0fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:8961:x1869324939724928:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782727320.749913:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6e0fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:8961:x1869324939724928:12345-0@lo:502:llog_process_th.0 Request processed in 133us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727320.749929:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1782727320.750142:0:8961:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7df60000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c71e9f0f-6441-4b9b-bc96-153ab9250801:8961:1869324939724928:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782727320.750170:0:8961:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782727320.750179:0:8961:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782727320.750181:0:8961:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1782727320.750188:0:8961:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff921c479c5800 00000020:00000080:0.0:1782727320.750191:0:8961:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1782727320.750260:0:8961:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7df60000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c71e9f0f-6441-4b9b-bc96-153ab9250801:8961:1869324939725056:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782727320.750295:0:8961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727320.750560:0:8961:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c7d81ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1782727320.750745:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939725056 00000100:00100000:2.0:1782727320.750874:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939725056 00000100:00100000:2.0:1782727320.752031:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1782727320.752045:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6e0ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:8961:x1869324939725056:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782727320.752193:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6e0ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:8961:x1869324939725056:12345-0@lo:502:llog_process_th.0 Request processed in 152us (1897us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727320.752201:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1782727320.753675:0:8961:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7df60000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c71e9f0f-6441-4b9b-bc96-153ab9250801:8961:1869324939725056:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782727320.753710:0:8961:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782727320.753719:0:8961:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782727320.753721:0:8961:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1782727320.753728:0:8961:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1782727320.755048:0:5946:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1782727320.755074:0:5946:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782727320.755085:0:5946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff921c4151d200/0x14a47870ee88cc68 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88cc6f expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727320.755096:0:5946:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff921c4151d200/0x14a47870ee88cc68 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88cc6f expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727321.018066:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727321.278498:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7d6e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869324939725312:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782727321.278574:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727321.278651:0:6952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939725312 00000100:00100000:2.0:1782727321.278659:0:6952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939725312 00000100:00100000:2.0:1782727321.278710:0:6952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1782727321.278720:0:6952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7d6e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324939725312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782727321.278750:0:6952:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1782727321.278794:0:6952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7d6e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324939725312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727321.278802:0:6952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1782727321.278839:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c7d6e8000 x1869324939725312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727337 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727321.278858:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7d6e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869324939725312:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782727321.278921:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782727321.278929:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7d6eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869324939725184:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782727321.278952:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727321.278976:0:6952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939725184 00000100:00100000:2.0:1782727321.278979:0:6952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939725184 00000100:00080000:1.0:1782727321.280314:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782727321.280320:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782727321.281859:0:6952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1782727321.281873:0:6952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7d6e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1869324939725184:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782727321.282755:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7dff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3443:1869324939725696:0@lo:400:kworker.0 00000100:00100000:0.0:1782727321.282824:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727321.282862:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782727321.282869:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7dffb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3443:1869324939725568:0@lo:400:kworker.0 00000100:00100000:0.0:1782727321.282906:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727321.282935:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939725696 00000100:00100000:0.0:1782727321.282942:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939725696 00000100:00100000:0.0:1782727321.282981:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939725568 00000100:00100000:0.0:1782727321.283004:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939725568 00000100:00100000:0.0:1782727321.283034:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1782727321.283040:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7df61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1869324939725696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727321.283090:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7df61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1869324939725696:12345-0@lo:400:kworker.0 Request processed in 50us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727321.283096:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1782727321.283113:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1782727321.283118:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7df61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1869324939725568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727321.283141:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7df61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1869324939725568:12345-0@lo:400:kworker.0 Request processed in 23us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727321.283146:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1782727321.283161:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782727321.283174:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7dff8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c71e9f0f-6441-4b9b-bc96-153ab9250801:3445:1869324939725440:0@lo:400:kworker.0 00000100:00100000:0.0:1782727321.283204:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727321.283232:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782727321.283238:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7dff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3445:1869324939725824:0@lo:400:kworker.0 00000100:00100000:0.0:1782727321.283263:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727321.283387:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7dffb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3443:1869324939725568:0@lo:400:kworker.0 00000100:00100000:0.0:1782727321.283399:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7dff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3443:1869324939725696:0@lo:400:kworker.0 00000100:00100000:0.0:1782727321.283424:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939725824 00000100:00100000:0.0:1782727321.283427:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939725824 00000100:00100000:0.0:1782727321.283448:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1782727321.283454:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7df62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1869324939725824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727321.283486:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7df62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1869324939725824:12345-0@lo:400:kworker.0 Request processed in 32us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727321.283501:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1782727321.283517:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782727321.283532:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7dff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3445:1869324939725824:0@lo:400:kworker.0 00002000:00000024:2.0:1782727321.283709:0:6952:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1782727321.283746:0:6952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7d6e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1869324939725184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1879us (4793us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727321.283760:0:6952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1782727321.283781:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939725440 00000100:00100000:2.0:1782727321.283784:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939725440 00000100:00100000:2.0:1782727321.283818:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1782727321.283825:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fe4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:3445:x1869324939725440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727321.283860:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fe4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:3445:x1869324939725440:12345-0@lo:400:kworker.0 Request processed in 36us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727321.283867:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00010000:00080000:2.0:1782727321.283932:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c7d6eb480 x1869324939725184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727337 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727321.283949:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7d6eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869324939725184:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782727321.283974:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7dff8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c71e9f0f-6441-4b9b-bc96-153ab9250801:3445:1869324939725440:0@lo:400:kworker.0 00000100:00100000:3.0:1782727321.602937:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1782727321.603030:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1782727321.603251:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914530816 00000100:00100000:1.0:1782727321.603263:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914530816 00000100:00100000:1.0:1782727321.603326:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 193 00000100:00100000:1.0:1782727321.603337:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fe4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecaf1fda-ff42-4054-9f39-8e142296107b+10:2356:x1869324914530816:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1782727321.603411:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fe4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecaf1fda-ff42-4054-9f39-8e142296107b+10:2356:x1869324914530816:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 76us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727321.603432:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 193 00000100:00100000:0.0:1782727321.603782:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914530944 00000100:00100000:0.0:1782727321.603787:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914530944 00000100:00100000:0.0:1782727321.603849:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 34 00000100:00100000:0.0:1782727321.603857:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dff9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d85bc959-008e-4782-8f39-df709fbb4636+6:2356:x1869324914530944:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1782727321.603924:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dff9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d85bc959-008e-4782-8f39-df709fbb4636+6:2356:x1869324914530944:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 68us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727321.603930:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 34 00000100:00080000:1.0:1782727321.604652:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782727321.608071:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1782727321.608106:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1782727321.608193:0:6949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914531072 00000100:00100000:2.0:1782727321.608202:0:6949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914531072 00000100:00100000:2.0:1782727321.608275:0:6949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914531200 00000100:00100000:2.0:1782727321.608277:0:6949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914531200 00000100:00100000:2.0:1782727321.608295:0:6949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 10 00000100:00100000:2.0:1782727321.608303:0:6949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dffa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d85bc959-008e-4782-8f39-df709fbb4636+5:2356:x1869324914531072:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1782727321.608370:0:6949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dffa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d85bc959-008e-4782-8f39-df709fbb4636+5:2356:x1869324914531072:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 63us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727321.608378:0:6949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 10 00000100:00100000:2.0:1782727321.608392:0:6949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 11 00000100:00100000:2.0:1782727321.608397:0:6949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dff9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d85bc959-008e-4782-8f39-df709fbb4636+5:2356:x1869324914531200:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1782727321.608417:0:6949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dff9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d85bc959-008e-4782-8f39-df709fbb4636+5:2356:x1869324914531200:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 20us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727321.608432:0:6949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 11 00000100:00080000:1.0:1782727321.608601:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782727321.608604:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1782727322.041107:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727323.066534:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727324.089003:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727325.113984:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782727325.518643:0:9187:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg260-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:0.0:1782727326.137088:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727326.393523:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7d6eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c71e9f0f-6441-4b9b-bc96-153ab9250801:3445:1869324939725952:0@lo:400:kworker.0 00000100:00100000:2.0:1782727326.393603:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727326.393654:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7d6e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3445:1869324939726464:0@lo:400:kworker.0 00000100:00100000:2.0:1782727326.393682:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727326.393706:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782727326.393710:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7d6ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869324939726336:0@lo:400:kworker.0 00000100:00100000:2.0:1782727326.393819:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727326.393858:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7d6e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3442:1869324939726080:0@lo:400:kworker.0 00000100:00100000:2.0:1782727326.393879:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727326.393917:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7d6eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869324939726592:0@lo:400:kworker.0 00000100:00100000:2.0:1782727326.393934:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727326.393957:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782727326.393962:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7d6eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3442:1869324939726208:0@lo:400:kworker.0 00000100:00100000:2.0:1782727326.393999:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727326.394029:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939725952 00000100:00100000:2.0:1782727326.394035:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939725952 00000100:00100000:2.0:1782727326.394073:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1782727326.394081:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fdb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:3445:x1869324939725952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727326.394127:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fdb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:3445:x1869324939725952:12345-0@lo:400:kworker.0 Request processed in 46us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727326.394134:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1782727326.394175:0:6949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939726336 00000100:00100000:2.0:1782727326.394179:0:6949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939726336 00000100:00100000:2.0:1782727326.394219:0:6949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939726592 00000100:00100000:2.0:1782727326.394222:0:6949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939726592 00000100:00100000:2.0:1782727326.394236:0:6949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1782727326.394242:0:6949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7d6e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324939726336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727326.394273:0:6949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7d6e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324939726336:12345-0@lo:400:kworker.0 Request processed in 31us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727326.394279:0:6949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1782727326.394289:0:6949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1782727326.394308:0:6949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7d6e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3442:x1869324939726592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727326.394334:0:6949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7d6e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3442:x1869324939726592:12345-0@lo:400:kworker.0 Request processed in 27us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727326.394339:0:6949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1782727326.394351:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782727326.394355:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1782727326.394378:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c7d6eaa00 x1869324939726592/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727326.394393:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7d6eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869324939726592:0@lo:400:kworker.0 00010000:00080000:2.0:1782727326.394419:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c7d6ead80 x1869324939726336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727326.394428:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7d6ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869324939726336:0@lo:400:kworker.0 00000100:00100000:2.0:1782727326.394437:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7d6eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c71e9f0f-6441-4b9b-bc96-153ab9250801:3445:1869324939725952:0@lo:400:kworker.0 00000100:00100000:3.0:1782727326.395037:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939726464 00000100:00100000:3.0:1782727326.395042:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939726464 00000100:00100000:3.0:1782727326.395072:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939726080 00000100:00100000:3.0:1782727326.395074:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939726080 00000100:00100000:3.0:1782727326.395084:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939726208 00000100:00100000:3.0:1782727326.395086:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939726208 00000100:00100000:3.0:1782727326.395099:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1782727326.395105:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7d6eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1869324939726464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727326.395161:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7d6eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1869324939726464:12345-0@lo:400:kworker.0 Request processed in 56us (1478us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727326.395168:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1782727326.395180:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1782727326.395185:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7d6e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1869324939726080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727326.395210:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7d6e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1869324939726080:12345-0@lo:400:kworker.0 Request processed in 25us (1330us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727326.395215:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1782727326.395226:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1782727326.395231:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dfcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1869324939726208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727326.395255:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dfcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1869324939726208:12345-0@lo:400:kworker.0 Request processed in 24us (1256us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727326.395261:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1782727326.395280:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782727326.395300:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7d6e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3445:1869324939726464:0@lo:400:kworker.0 00000100:00100000:1.0:1782727326.395492:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7d6eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3442:1869324939726208:0@lo:400:kworker.0 00000100:00100000:1.0:1782727326.395504:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7d6e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3442:1869324939726080:0@lo:400:kworker.0 00000100:00100000:1.0:1782727326.395517:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782727326.395524:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7dffbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869324939726720:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782727326.395555:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727326.395659:0:6952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939726720 00000100:00100000:3.0:1782727326.395664:0:6952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939726720 00000100:00100000:3.0:1782727326.395697:0:6952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1782727326.395703:0:6952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dfc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1869324939726720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782727326.395730:0:6952:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1782727326.395771:0:6952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dfc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1869324939726720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727326.395778:0:6952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1782727326.396039:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c7dffbb80 x1869324939726720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727342 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727326.396055:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7dffbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869324939726720:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782727326.397098:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7df60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869324939726848:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782727326.397142:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727326.397398:0:6952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939726848 00000100:00100000:3.0:1782727326.397404:0:6952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939726848 00000100:00100000:3.0:1782727326.397461:0:6952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1782727326.397469:0:6952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dfc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324939726848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782727326.397493:0:6952:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1782727326.405283:0:6952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dfc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324939726848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 7803us (8128us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727326.405299:0:6952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1782727326.408520:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c7df60000 x1869324939726848/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727342 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727326.408545:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7df60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869324939726848:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782727326.722038:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1782727326.722079:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1782727326.722113:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1782727326.722145:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1782727326.722172:0:6949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914531712 00000100:00100000:3.0:1782727326.722181:0:6949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914531712 00000100:00100000:1.0:1782727326.722189:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914531456 00000100:00100000:1.0:1782727326.722193:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914531456 00000100:00100000:3.0:1782727326.722235:0:6949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914531584 00000100:00100000:3.0:1782727326.722238:0:6949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914531584 00000100:00100000:1.0:1782727326.722241:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 38 00000100:00100000:1.0:1782727326.722250:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dffa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d85bc959-008e-4782-8f39-df709fbb4636+6:2357:x1869324914531456:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1782727326.722253:0:6949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 14 00000100:00100000:3.0:1782727326.722258:0:6949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dff8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d85bc959-008e-4782-8f39-df709fbb4636+5:2357:x1869324914531712:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1782727326.722322:0:6949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dff8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d85bc959-008e-4782-8f39-df709fbb4636+5:2357:x1869324914531712:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 62us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727326.722330:0:6949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 14 00000100:00100000:0.0:1782727326.722340:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914531328 00000100:00100000:0.0:1782727326.722344:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914531328 00000100:00100000:3.0:1782727326.722345:0:6949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 15 00000100:00100000:3.0:1782727326.722351:0:6949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dffbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d85bc959-008e-4782-8f39-df709fbb4636+5:2357:x1869324914531584:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1782727326.722372:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 195 00000100:00100000:0.0:1782727326.722378:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fdb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecaf1fda-ff42-4054-9f39-8e142296107b+10:2358:x1869324914531328:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1782727326.724109:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dffa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d85bc959-008e-4782-8f39-df709fbb4636+6:2357:x1869324914531456:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 1849us (2018us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727326.724123:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 38 00000100:00100000:3.0:1782727326.728111:0:6949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dffbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d85bc959-008e-4782-8f39-df709fbb4636+5:2357:x1869324914531584:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 5749us (5954us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727326.728111:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fdb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecaf1fda-ff42-4054-9f39-8e142296107b+10:2358:x1869324914531328:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 5722us (6073us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727326.728126:0:6949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 15 00000100:00100000:0.0:1782727326.728126:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 195 00000100:00080000:3.0:1782727326.728179:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782727326.728185:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782727326.728201:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1782727327.163989:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727328.186464:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727329.211146:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727330.234023:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727331.257260:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782727331.508122:0:9431:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg260-server.virtnet: executing yml_node 00000100:00100000:2.0:1782727331.513174:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7dfcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869324939727360:0@lo:400:kworker.0 00000100:00100000:2.0:1782727331.513246:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727331.513301:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1782727331.513308:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7dfcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c71e9f0f-6441-4b9b-bc96-153ab9250801:3444:1869324939726976:0@lo:400:kworker.0 00000100:00100000:2.0:1782727331.513350:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727331.513376:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7dfcf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3444:1869324939727488:0@lo:400:kworker.0 00000100:00100000:2.0:1782727331.513400:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727331.513426:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7dfce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3442:1869324939727104:0@lo:400:kworker.0 00000100:00100000:2.0:1782727331.513450:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727331.513468:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7dfcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869324939727616:0@lo:400:kworker.0 00000100:00100000:2.0:1782727331.513487:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727331.513505:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782727331.513510:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7dfcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3442:1869324939727232:0@lo:400:kworker.0 00000100:00100000:2.0:1782727331.513531:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727331.513562:0:6949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939727360 00000100:00100000:2.0:1782727331.513569:0:6949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939727360 00000100:00100000:2.0:1782727331.513616:0:6949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939727616 00000100:00100000:2.0:1782727331.513619:0:6949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939727616 00000100:00100000:2.0:1782727331.513637:0:6949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1782727331.513645:0:6949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dfced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324939727360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727331.513700:0:6949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dfced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324939727360:12345-0@lo:400:kworker.0 Request processed in 56us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727331.513709:0:6949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1782727331.513724:0:6949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1782727331.513730:0:6949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dfcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3442:x1869324939727616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727331.513779:0:6949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dfcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3442:x1869324939727616:12345-0@lo:400:kworker.0 Request processed in 49us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727331.513786:0:6949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1782727331.513803:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939726976 00000100:00100000:2.0:1782727331.513806:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939726976 00000100:00100000:2.0:1782727331.513830:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1782727331.513836:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fdb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:3444:x1869324939726976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727331.513863:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fdb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:3444:x1869324939726976:12345-0@lo:400:kworker.0 Request processed in 27us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727331.513869:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1782727331.513929:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939727488 00000100:00100000:2.0:1782727331.513933:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939727488 00000100:00100000:2.0:1782727331.513952:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939727104 00000100:00100000:2.0:1782727331.513955:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939727104 00000100:00100000:2.0:1782727331.513963:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939727232 00000100:00100000:2.0:1782727331.513965:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939727232 00000100:00100000:2.0:1782727331.513979:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1782727331.513985:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dfcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1869324939727488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727331.514020:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dfcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1869324939727488:12345-0@lo:400:kworker.0 Request processed in 35us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727331.514025:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1782727331.514037:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1782727331.514042:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dfcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1869324939727104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727331.514065:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dfcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1869324939727104:12345-0@lo:400:kworker.0 Request processed in 23us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727331.514070:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1782727331.514079:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1782727331.514095:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dfcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1869324939727232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727331.514121:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dfcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1869324939727232:12345-0@lo:400:kworker.0 Request processed in 28us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727331.514126:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:2.0:1782727331.514150:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782727331.514154:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782727331.514155:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782727331.514187:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7dfcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3442:1869324939727232:0@lo:400:kworker.0 00000100:00100000:2.0:1782727331.514198:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7dfce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3442:1869324939727104:0@lo:400:kworker.0 00010000:00080000:2.0:1782727331.514208:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c7dfcea00 x1869324939727616/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727331.514217:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7dfcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869324939727616:0@lo:400:kworker.0 00000100:00100000:2.0:1782727331.514242:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7dfcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c71e9f0f-6441-4b9b-bc96-153ab9250801:3444:1869324939726976:0@lo:400:kworker.0 00000100:00100000:2.0:1782727331.514251:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7dfcf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3444:1869324939727488:0@lo:400:kworker.0 00010000:00080000:2.0:1782727331.514259:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c7dfcce00 x1869324939727360/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727331.514266:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7dfcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869324939727360:0@lo:400:kworker.0 00000100:00100000:1.0:1782727331.514699:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782727331.514711:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7dff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869324939727872:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782727331.514753:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727331.514829:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7dff8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869324939727744:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782727331.514855:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727331.514900:0:6952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939727872 00000100:00100000:2.0:1782727331.514916:0:6952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939727872 00000100:00100000:2.0:1782727331.514938:0:6952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939727744 00000100:00100000:2.0:1782727331.514941:0:6952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939727744 00000100:00100000:2.0:1782727331.514951:0:6952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1782727331.514965:0:6952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dfc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324939727872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782727331.514988:0:6952:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1782727331.515033:0:6952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dfc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324939727872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727331.515040:0:6952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1782727331.515053:0:6952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1782727331.515059:0:6952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dfcce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1869324939727744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782727331.515074:0:6952:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1782727331.515104:0:6952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dfcce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1869324939727744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 45us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727331.515110:0:6952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1782727331.515137:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c7dff8700 x1869324939727744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727347 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727331.515152:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7dff8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869324939727744:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1782727331.515226:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c7dff9880 x1869324939727872/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727347 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727331.515238:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7dff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869324939727872:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782727331.854675:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1782727331.854716:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1782727331.855605:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914531840 00000100:00100000:3.0:1782727331.855617:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914531840 00000100:00100000:3.0:1782727331.855683:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 197 00000100:00100000:3.0:1782727331.855694:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fdb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecaf1fda-ff42-4054-9f39-8e142296107b+10:2356:x1869324914531840:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1782727331.855845:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1782727331.855940:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fdb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecaf1fda-ff42-4054-9f39-8e142296107b+10:2356:x1869324914531840:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 246us (1274us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727331.855948:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 197 00000100:00100000:0.0:1782727331.859760:0:6949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914532096 00000100:00100000:0.0:1782727331.859774:0:6949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914532096 00000100:00100000:0.0:1782727331.859852:0:6949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 10 00000100:00100000:0.0:1782727331.859913:0:6949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dfcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d85bc959-008e-4782-8f39-df709fbb4636+5:2354:x1869324914532096:12345-192.168.202.60@tcp:9:kworker.0 00000020:00000080:0.0:1782727331.859949:0:6949:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x14a47870ee88cbab 00000100:00080000:0.0:1782727331.859958:0:6949:0:(import.c:65:import_set_state_nolock()) ffff921c7db04000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1782727331.860000:0:6949:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00080000:1.0:1782727331.861727:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782727331.861764:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914531968 00000100:00100000:1.0:1782727331.861773:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914531968 00000100:00100000:1.0:1782727331.861846:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 42 00000100:00100000:1.0:1782727331.861855:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dfcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d85bc959-008e-4782-8f39-df709fbb4636+6:2356:x1869324914531968:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1782727331.862319:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1782727331.862341:0:6950:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1782727331.862350:0:6950:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00010000:00010000:3.0:1782727331.864550:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1782727331.864572:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782727331.866920:0:6950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914532224 00000100:00100000:2.0:1782727331.866933:0:6950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914532224 00000100:00080000:2.0:1782727331.867007:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782727331.867096:0:9464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 11 00000100:00100000:2.0:1782727331.867108:0:9464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dfcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d85bc959-008e-4782-8f39-df709fbb4636+5:2354:x1869324914532224:12345-192.168.202.60@tcp:9:kworker.0 00000020:00000080:2.0:1782727331.867146:0:9464:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x14a47870ee88cbb2 00000100:00080000:2.0:1782727331.867161:0:9464:0:(import.c:65:import_set_state_nolock()) ffff921c6dd22000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1782727331.867235:0:9464:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1782727331.867409:0:9464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dfcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d85bc959-008e-4782-8f39-df709fbb4636+2:2354:x1869324914532224:12345-192.168.202.60@tcp:9:kworker.0 Request processed in 303us (5091us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727331.867418:0:9464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 11 00010000:00010000:0.0:1782727331.868940:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727331.869018:0:6949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dfcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d85bc959-008e-4782-8f39-df709fbb4636+2:2354:x1869324914532096:12345-192.168.202.60@tcp:9:kworker.0 Request processed in 9111us (14268us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727331.869029:0:6949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 10 00000100:00100000:0.0:1782727331.871946:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dfcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d85bc959-008e-4782-8f39-df709fbb4636+6:2356:x1869324914531968:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 10080us (17216us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727331.871960:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 42 00010000:00010000:2.0:1782727332.286945:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727333.305065:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727334.329421:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727335.357535:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727336.378690:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727336.633099:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7dfc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869324939728000:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782727336.633196:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727336.633289:0:6952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939728000 00000100:00100000:1.0:1782727336.633310:0:6952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939728000 00000100:00100000:1.0:1782727336.633385:0:6952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1782727336.633396:0:6952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dfc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324939728000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782727336.633438:0:6952:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1782727336.633489:0:6952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dfc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324939728000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727336.633497:0:6952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1782727336.633524:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1782727336.633561:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c7dfc0000 x1869324939728000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727352 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727336.633583:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7dfc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869324939728000:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782727336.634470:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7dfce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c71e9f0f-6441-4b9b-bc96-153ab9250801:3442:1869324939728128:0@lo:400:kworker.0 00000100:00100000:2.0:1782727336.634527:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727336.634563:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7dfcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3442:1869324939728640:0@lo:400:kworker.0 00000100:00100000:2.0:1782727336.634589:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727336.634611:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782727336.634617:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7dfcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3442:1869324939728256:0@lo:400:kworker.0 00000100:00100000:2.0:1782727336.634639:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727336.634673:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939728128 00000100:00100000:2.0:1782727336.634679:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939728128 00000100:00100000:2.0:1782727336.634725:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1782727336.634732:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fdb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:3442:x1869324939728128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727336.634777:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fdb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:3442:x1869324939728128:12345-0@lo:400:kworker.0 Request processed in 44us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727336.634935:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1782727336.634974:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939728640 00000100:00100000:2.0:1782727336.634977:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939728640 00000100:00100000:1.0:1782727336.635133:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7dfcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3444:1869324939728384:0@lo:400:kworker.0 00000100:00100000:1.0:1782727336.635166:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727336.635215:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782727336.635221:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7dfcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869324939728512:0@lo:400:kworker.0 00000100:00100000:1.0:1782727336.635248:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727336.635280:0:6950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939728512 00000100:00100000:1.0:1782727336.635284:0:6950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939728512 00000100:00100000:1.0:1782727336.635332:0:6950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1782727336.635340:0:6950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dfc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324939728512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727336.635384:0:6950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dfc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324939728512:12345-0@lo:400:kworker.0 Request processed in 44us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727336.635390:0:6950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1782727336.635411:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7dfc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869324939728768:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782727336.635440:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1782727336.635469:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782727336.635476:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1782727336.635504:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c7dfcf480 x1869324939728512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727352 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727336.635519:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7dfcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869324939728512:0@lo:400:kworker.0 00000100:00100000:1.0:1782727336.635547:0:6952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939728768 00000100:00100000:1.0:1782727336.635550:0:6952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939728768 00000100:00100000:1.0:1782727336.635573:0:6952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1782727336.635580:0:6952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dfc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1869324939728768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782727336.635604:0:6952:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1782727336.635644:0:6952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dfc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1869324939728768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727336.635650:0:6952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1782727336.635678:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c7dfc0000 x1869324939728768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727352 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727336.635708:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7dfc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869324939728768:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782727336.636079:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939728256 00000100:00100000:0.0:1782727336.636086:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939728256 00000100:00100000:2.0:1782727336.636148:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939728384 00000100:00100000:2.0:1782727336.636152:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939728384 00000100:00100000:0.0:1782727336.636358:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1782727336.636368:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dfcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1869324939728640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727336.636424:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dfcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1869324939728640:12345-0@lo:400:kworker.0 Request processed in 57us (1832us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727336.636431:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1782727336.636445:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1782727336.636451:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dfcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1869324939728256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727336.636479:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dfcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1869324939728256:12345-0@lo:400:kworker.0 Request processed in 30us (1839us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727336.636485:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1782727336.636619:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1782727336.636627:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dfc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869324939728384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727336.636678:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dfc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869324939728384:12345-0@lo:400:kworker.0 Request processed in 53us (1511us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727336.636684:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1782727336.636732:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7dfcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3442:1869324939728256:0@lo:400:kworker.0 00000100:00100000:2.0:1782727336.636744:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7dfce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c71e9f0f-6441-4b9b-bc96-153ab9250801:3442:1869324939728128:0@lo:400:kworker.0 00000100:00100000:2.0:1782727336.636754:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7dfcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3442:1869324939728640:0@lo:400:kworker.0 00000100:00080000:1.0:1782727336.637406:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782727336.637443:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7dfcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3444:1869324939728384:0@lo:400:kworker.0 00000001:02000400:1.0:1782727336.670976:0:9615:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.54.83 00000100:00100000:3.0:1782727336.978274:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1782727336.978368:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1782727336.978424:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914532480 00000100:00100000:3.0:1782727336.978437:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914532480 00000100:00100000:3.0:1782727336.978530:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 46 00000100:00100000:3.0:1782727336.978542:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dff8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d85bc959-008e-4782-8f39-df709fbb4636+6:2356:x1869324914532480:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1782727336.978653:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dff8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d85bc959-008e-4782-8f39-df709fbb4636+6:2356:x1869324914532480:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 113us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727336.978662:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 46 00000100:00080000:3.0:1782727336.978841:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782727336.993056:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914532352 00000100:00100000:2.0:1782727336.993077:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914532352 00000100:00100000:2.0:1782727336.993146:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 199 00000100:00100000:2.0:1782727336.993158:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fdb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecaf1fda-ff42-4054-9f39-8e142296107b+10:2356:x1869324914532352:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1782727336.993257:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fdb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecaf1fda-ff42-4054-9f39-8e142296107b+10:2356:x1869324914532352:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 102us (15000us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727336.993265:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 199 00000001:00100000:0.0:1782727337.151320:0:6943:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d85bc959-008e-4782-8f39-df709fbb4636 00000020:00000080:0.0:1782727337.151334:0:6943:0:(genops.c:906:class_export_put()) final put ffff921c7db03800/d85bc959-008e-4782-8f39-df709fbb4636 00000020:00000080:2.0:1782727337.151761:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff921c7db03800/d85bc959-008e-4782-8f39-df709fbb4636 for lustre-OST0000 00000020:00000080:2.0:1782727337.151832:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff921c7db04000 for lustre-OST0000 00000001:00100000:3.0:1782727337.154985:0:8019:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d85bc959-008e-4782-8f39-df709fbb4636 00000020:00000080:3.0:1782727337.154999:0:8019:0:(genops.c:906:class_export_put()) final put ffff921c7db01000/d85bc959-008e-4782-8f39-df709fbb4636 00000020:00000080:0.0:1782727337.155284:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff921c7db01000/d85bc959-008e-4782-8f39-df709fbb4636 for lustre-OST0001 00000020:00000080:0.0:1782727337.155378:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff921c6dd22000 for lustre-OST0001 00010000:00010000:2.0:1782727337.403616:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727338.427729:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727339.450687:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782727339.926565:0:9714:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.54.83 00010000:00010000:2.0:1782727340.473407:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727341.500843:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727341.754021:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7dfce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3445:1869324939729024:0@lo:400:kworker.0 00000100:00100000:3.0:1782727341.754113:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727341.754185:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7dfcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869324939729536:0@lo:400:kworker.0 00000100:00100000:3.0:1782727341.754211:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727341.754239:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1782727341.754245:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7dfcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c71e9f0f-6441-4b9b-bc96-153ab9250801:3445:1869324939728896:0@lo:400:kworker.0 00000100:00100000:3.0:1782727341.754270:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727341.754292:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7dfcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3445:1869324939729408:0@lo:400:kworker.0 00000100:00100000:3.0:1782727341.754313:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727341.754343:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939728896 00000100:00100000:3.0:1782727341.754350:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939728896 00000100:00100000:3.0:1782727341.754390:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1782727341.754399:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fdb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:3445:x1869324939728896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727341.754445:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fdb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:3445:x1869324939728896:12345-0@lo:400:kworker.0 Request processed in 46us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727341.754453:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1782727341.754485:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939729024 00000100:00100000:3.0:1782727341.754489:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939729024 00000100:00100000:3.0:1782727341.754510:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939729408 00000100:00100000:3.0:1782727341.754513:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939729408 00000100:00100000:3.0:1782727341.754535:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1782727341.754542:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dffb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1869324939729024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727341.754585:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dffb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1869324939729024:12345-0@lo:400:kworker.0 Request processed in 31us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727341.754592:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1782727341.754604:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1782727341.754609:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dffaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1869324939729408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727341.754645:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dffaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1869324939729408:12345-0@lo:400:kworker.0 Request processed in 35us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727341.754651:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:3.0:1782727341.754669:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782727341.754691:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7dfcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c71e9f0f-6441-4b9b-bc96-153ab9250801:3445:1869324939728896:0@lo:400:kworker.0 00000100:00100000:3.0:1782727341.754702:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7dfcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3445:1869324939729408:0@lo:400:kworker.0 00000100:00100000:3.0:1782727341.754712:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7dfce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3445:1869324939729024:0@lo:400:kworker.0 00000100:00100000:0.0:1782727341.754921:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7dfcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3442:1869324939729152:0@lo:400:kworker.0 00000100:00100000:0.0:1782727341.754951:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727341.754968:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782727341.754973:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7dfce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869324939729280:0@lo:400:kworker.0 00000100:00100000:0.0:1782727341.754993:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727341.755017:0:6949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939729536 00000100:00100000:0.0:1782727341.755020:0:6949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939729536 00000100:00100000:0.0:1782727341.755051:0:6949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939729280 00000100:00100000:0.0:1782727341.755053:0:6949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939729280 00000100:00100000:0.0:1782727341.755070:0:6949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1782727341.755076:0:6949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dffb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324939729536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727341.755107:0:6949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dffb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324939729536:12345-0@lo:400:kworker.0 Request processed in 32us (896us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727341.755113:0:6949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1782727341.755125:0:6949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1782727341.755130:0:6949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7df63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3442:x1869324939729280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727341.755176:0:6949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7df63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3442:x1869324939729280:12345-0@lo:400:kworker.0 Request processed in 46us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727341.755182:0:6949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1782727341.755197:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782727341.755200:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1782727341.755217:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c7dfce680 x1869324939729280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727341.755228:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7dfce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869324939729280:0@lo:400:kworker.0 00000100:00100000:1.0:1782727341.755412:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782727341.755421:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7dfc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869324939729664:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782727341.755450:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727341.755476:0:6952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939729664 00000100:00100000:1.0:1782727341.755479:0:6952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939729664 00000100:00100000:1.0:1782727341.755506:0:6952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1782727341.755513:0:6952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dfc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1869324939729664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782727341.755534:0:6952:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1782727341.755567:0:6952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dfc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1869324939729664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727341.755573:0:6952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1782727341.755601:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c7dfc0000 x1869324939729664/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727357 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727341.755615:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7dfc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869324939729664:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782727341.755759:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939729152 00000100:00100000:2.0:1782727341.755763:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939729152 00000100:00100000:2.0:1782727341.755803:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1782727341.755810:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7df63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1869324939729152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727341.755852:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7df63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1869324939729152:12345-0@lo:400:kworker.0 Request processed in 42us (900us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727341.755870:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:0.0:1782727341.755956:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782727341.756005:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7df62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869324939729792:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782727341.756029:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727341.756071:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7dfcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3442:1869324939729152:0@lo:400:kworker.0 00000100:00100000:0.0:1782727341.756128:0:6952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939729792 00000100:00100000:0.0:1782727341.756132:0:6952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939729792 00000100:00100000:0.0:1782727341.756172:0:6952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1782727341.756178:0:6952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dfc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1869324939729792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782727341.756194:0:6952:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1782727341.756235:0:6952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dfc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1869324939729792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727341.756241:0:6952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1782727341.756351:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c7df62d80 x1869324939729792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727357 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727341.756364:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7df62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869324939729792:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1782727341.756822:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c7dfcf480 x1869324939729536/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727341.756832:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7dfcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869324939729536:0@lo:400:kworker.0 00000100:00100000:3.0:1782727342.082205:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1782727342.082280:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1782727342.082665:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914532736 00000100:00100000:0.0:1782727342.082679:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914532736 00000100:00100000:0.0:1782727342.082784:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 50 00000100:00100000:0.0:1782727342.082805:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dff8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d85bc959-008e-4782-8f39-df709fbb4636+6:2356:x1869324914532736:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1782727342.082979:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dff8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d85bc959-008e-4782-8f39-df709fbb4636+6:2356:x1869324914532736:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 176us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727342.082987:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 50 00000100:00100000:2.0:1782727342.083685:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914532608 00000100:00100000:2.0:1782727342.083695:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914532608 00000100:00100000:2.0:1782727342.083753:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 201 00000100:00100000:2.0:1782727342.083762:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fdb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecaf1fda-ff42-4054-9f39-8e142296107b+10:2356:x1869324914532608:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1782727342.083841:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fdb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecaf1fda-ff42-4054-9f39-8e142296107b+10:2356:x1869324914532608:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 80us (1655us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727342.083849:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 201 00000100:00080000:3.0:1782727342.084357:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782727342.525091:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782727342.931559:0:9811:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.54.83 00010000:00010000:2.0:1782727343.545515:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727344.573254:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782727344.870153:0:9860:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity ============----- Mon Jun 29 06:02:22 EDT 2026 00010000:00010000:3.0:1782727345.593128:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727346.624149:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727346.873147:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7df61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869324939730048:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782727346.873167:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7dfce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3442:1869324939730304:0@lo:400:kworker.0 00000100:00100000:3.0:1782727346.877694:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7dfcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3445:1869324939730176:0@lo:400:kworker.0 00000100:00100000:1.0:1782727346.878046:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727346.878146:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7dfcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c71e9f0f-6441-4b9b-bc96-153ab9250801:3444:1869324939729920:0@lo:400:kworker.0 00000100:00100000:2.0:1782727346.878153:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727346.878328:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727346.878370:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7dfcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3444:1869324939730560:0@lo:400:kworker.0 00000100:00100000:1.0:1782727346.878396:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727346.878634:0:6952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939730048 00000100:00100000:0.0:1782727346.878647:0:6952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939730048 00000100:00100000:0.0:1782727346.878716:0:6952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1782727346.878727:0:6952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dfc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324939730048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782727346.878768:0:6952:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1782727346.878832:0:6952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dfc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324939730048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727346.878840:0:6952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1782727346.878870:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939730304 00000100:00100000:0.0:1782727346.878873:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939730304 00000100:00100000:0.0:1782727346.878920:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939730560 00000100:00100000:0.0:1782727346.878932:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939730560 00000100:00100000:0.0:1782727346.878950:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1782727346.878956:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7d6e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1869324939730304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727346.878994:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7d6e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1869324939730304:12345-0@lo:400:kworker.0 Request processed in 38us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727346.879001:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1782727346.879012:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1782727346.879017:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dfc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1869324939730560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727346.879043:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dfc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1869324939730560:12345-0@lo:400:kworker.0 Request processed in 25us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727346.879049:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:1.0:1782727346.879373:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782727346.879379:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782727346.879415:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7dfcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3444:1869324939730560:0@lo:400:kworker.0 00010000:00080000:1.0:1782727346.879430:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c7df61c00 x1869324939730048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727362 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727346.879449:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7df61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869324939730048:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782727346.879633:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727346.879672:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7dfcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869324939730688:0@lo:400:kworker.0 00000100:00100000:3.0:1782727346.879705:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727346.879746:0:6949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939730688 00000100:00100000:3.0:1782727346.879751:0:6949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939730688 00000100:00100000:3.0:1782727346.879801:0:6949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1782727346.879808:0:6949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dff9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324939730688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727346.879865:0:6949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dff9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324939730688:12345-0@lo:400:kworker.0 Request processed in 57us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727346.879873:0:6949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1782727346.880167:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939730176 00000100:00100000:1.0:1782727346.880172:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939730176 00000100:00100000:1.0:1782727346.880342:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1782727346.880351:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dffad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1869324939730176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727346.880388:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dffad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1869324939730176:12345-0@lo:400:kworker.0 Request processed in 39us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727346.880394:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:3.0:1782727346.880627:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782727346.880665:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7dfcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3445:1869324939730176:0@lo:400:kworker.0 00010000:00080000:3.0:1782727346.880679:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c7dfcc000 x1869324939730688/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727346.880689:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7dfcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869324939730688:0@lo:400:kworker.0 00000100:00100000:2.0:1782727346.880938:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7dfce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3442:1869324939730304:0@lo:400:kworker.0 00000100:00100000:2.0:1782727346.880961:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7df61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869324939730816:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782727346.881021:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727346.881106:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782727346.881113:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7dfce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869324939730432:0@lo:400:kworker.0 00000100:00100000:2.0:1782727346.881141:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727346.881380:0:6952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939730816 00000100:00100000:0.0:1782727346.881386:0:6952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939730816 00000100:00100000:0.0:1782727346.881428:0:6952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782727346.881436:0:6952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7d6eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1869324939730816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782727346.881465:0:6952:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1782727346.881509:0:6952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7d6eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1869324939730816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727346.881516:0:6952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1782727346.881631:0:6951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939730432 00000100:00100000:1.0:1782727346.881636:0:6951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939730432 00000100:00100000:1.0:1782727346.881665:0:6951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1782727346.881672:0:6951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7d6e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3442:x1869324939730432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727346.881709:0:6951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7d6e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3442:x1869324939730432:12345-0@lo:400:kworker.0 Request processed in 37us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727346.881716:0:6951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1782727346.882173:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939729920 00000100:00100000:0.0:1782727346.882179:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939729920 00010000:00080000:2.0:1782727346.882186:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c7dfce300 x1869324939730432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727346.882201:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7dfce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869324939730432:0@lo:400:kworker.0 00010000:00080000:2.0:1782727346.882247:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c7df61f80 x1869324939730816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727362 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727346.882263:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7df61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869324939730816:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782727346.882735:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1782727346.882745:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fdb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:3444:x1869324939729920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727346.882827:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fdb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:3444:x1869324939729920:12345-0@lo:400:kworker.0 Request processed in 83us (4550us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727346.882835:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1782727346.882906:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7dfcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c71e9f0f-6441-4b9b-bc96-153ab9250801:3444:1869324939729920:0@lo:400:kworker.0 00000100:00100000:3.0:1782727347.206933:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1782727347.206993:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1782727347.207114:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914532864 00000100:00100000:1.0:1782727347.207128:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914532864 00000100:00100000:1.0:1782727347.207198:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 203 00000100:00100000:1.0:1782727347.207223:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fdb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecaf1fda-ff42-4054-9f39-8e142296107b+10:2356:x1869324914532864:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1782727347.207325:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fdb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecaf1fda-ff42-4054-9f39-8e142296107b+10:2356:x1869324914532864:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 116us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727347.207335:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 203 00000100:00100000:2.0:1782727347.207735:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914532992 00000100:00100000:2.0:1782727347.207742:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914532992 00000100:00100000:2.0:1782727347.207813:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 54 00000100:00100000:2.0:1782727347.207822:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dff8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d85bc959-008e-4782-8f39-df709fbb4636+6:2356:x1869324914532992:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1782727347.207868:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dff8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d85bc959-008e-4782-8f39-df709fbb4636+6:2356:x1869324914532992:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 49us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727347.207874:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 54 00000100:00080000:1.0:1782727347.208087:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782727347.646313:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727348.668816:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727349.693325:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727350.713120:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727351.741043:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727351.993236:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782727351.993269:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7df60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869324939731072:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782727351.993365:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727351.993444:0:6952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939731072 00000100:00100000:0.0:1782727351.993464:0:6952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939731072 00000100:00100000:0.0:1782727351.993537:0:6952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1782727351.993547:0:6952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7df62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324939731072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782727351.993588:0:6952:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1782727351.993639:0:6952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7df62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324939731072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727351.993648:0:6952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1782727351.993674:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1782727351.993711:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c7df60380 x1869324939731072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727367 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727351.993742:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7df60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869324939731072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782727351.994324:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7d6eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3442:1869324939731328:0@lo:400:kworker.0 00000100:00100000:2.0:1782727351.994370:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727351.994398:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1782727351.994404:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7d6eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c71e9f0f-6441-4b9b-bc96-153ab9250801:3442:1869324939730944:0@lo:400:kworker.0 00000100:00100000:2.0:1782727351.994439:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727351.994464:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e13ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869324939731456:0@lo:400:kworker.0 00000100:00100000:2.0:1782727351.994490:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727351.994525:0:6949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939731456 00000100:00100000:2.0:1782727351.994530:0:6949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939731456 00000100:00100000:2.0:1782727351.994575:0:6949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1782727351.994583:0:6949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e13df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3442:x1869324939731456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727351.994625:0:6949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e13df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3442:x1869324939731456:12345-0@lo:400:kworker.0 Request processed in 44us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727351.994632:0:6949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1782727351.994671:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c7e13ed80 x1869324939731456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727351.994690:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e13ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869324939731456:0@lo:400:kworker.0 00000100:00100000:0.0:1782727351.994752:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939731328 00000100:00100000:0.0:1782727351.994827:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939731328 00000100:00100000:0.0:1782727351.994868:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1782727351.994875:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e13f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1869324939731328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727351.994939:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e13f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1869324939731328:12345-0@lo:400:kworker.0 Request processed in 65us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727351.994946:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1782727351.994966:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939730944 00000100:00100000:0.0:1782727351.994970:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939730944 00000100:00100000:0.0:1782727351.994997:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1782727351.995004:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fdb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:3442:x1869324939730944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727351.995034:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fdb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:3442:x1869324939730944:12345-0@lo:400:kworker.0 Request processed in 31us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727351.995041:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00080000:0.0:1782727351.995071:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782727351.995239:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e13c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3444:1869324939731584:0@lo:400:kworker.0 00000100:00100000:3.0:1782727351.995276:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727351.995303:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782727351.995310:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7d6ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869324939731200:0@lo:400:kworker.0 00000100:00100000:3.0:1782727351.995333:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727351.995417:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939731584 00000100:00100000:3.0:1782727351.995421:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939731584 00000100:00100000:2.0:1782727351.995559:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939731200 00000100:00100000:2.0:1782727351.995563:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939731200 00000100:00080000:0.0:1782727351.995589:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782727351.995717:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7d6eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c71e9f0f-6441-4b9b-bc96-153ab9250801:3442:1869324939730944:0@lo:400:kworker.0 00000100:00100000:0.0:1782727351.995745:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7d6eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3442:1869324939731328:0@lo:400:kworker.0 00000100:00100000:0.0:1782727351.999016:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7df60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869324939731712:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782727351.999134:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727351.999221:0:6952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939731712 00000100:00100000:0.0:1782727351.999229:0:6952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939731712 00000100:00100000:0.0:1782727351.999288:0:6952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1782727351.999298:0:6952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7df60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324939731712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782727351.999338:0:6952:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1782727351.999389:0:6952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7df60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324939731712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727351.999397:0:6952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1782727351.999446:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c7df60380 x1869324939731712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727367 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727351.999470:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7df60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869324939731712:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782727352.001585:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1782727352.001602:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c76441500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1869324939731584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727352.001712:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c76441500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1869324939731584:12345-0@lo:400:kworker.0 Request processed in 114us (6434us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727352.001721:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1782727352.001796:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e13c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3444:1869324939731584:0@lo:400:kworker.0 00000100:00080000:0.0:1782727352.005016:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782727352.010558:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1782727352.010578:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c76441180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869324939731200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727352.010711:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c76441180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869324939731200:12345-0@lo:400:kworker.0 Request processed in 138us (15376us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727352.010720:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1782727352.012051:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7d6ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869324939731200:0@lo:400:kworker.0 00000100:00100000:3.0:1782727352.328479:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1782727352.329104:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1782727352.330098:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914533248 00000100:00100000:2.0:1782727352.330116:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914533248 00000100:00100000:2.0:1782727352.330233:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 58 00000100:00100000:2.0:1782727352.330246:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e031f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d85bc959-008e-4782-8f39-df709fbb4636+6:2358:x1869324914533248:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1782727352.330361:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e031f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d85bc959-008e-4782-8f39-df709fbb4636+6:2358:x1869324914533248:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 117us (1258us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727352.330371:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 58 00000100:00080000:3.0:1782727352.331786:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782727352.341550:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914533120 00000100:00100000:1.0:1782727352.341575:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914533120 00000100:00100000:1.0:1782727352.341721:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 205 00000100:00100000:1.0:1782727352.341770:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fdb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecaf1fda-ff42-4054-9f39-8e142296107b+10:2358:x1869324914533120:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1782727352.341905:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fdb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecaf1fda-ff42-4054-9f39-8e142296107b+10:2358:x1869324914533120:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 138us (13442us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727352.341914:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 205 00010000:00010000:0.0:1782727352.769560:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727353.786342:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727354.809468:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727355.835518:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727356.863179:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727357.114065:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7df60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869324939731840:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782727357.114140:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727357.114192:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782727357.114199:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7df61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869324939731968:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782727357.114223:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727357.114269:0:6952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939731840 00000100:00100000:0.0:1782727357.114277:0:6952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939731840 00000100:00100000:0.0:1782727357.114321:0:6952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939731968 00000100:00100000:0.0:1782727357.114324:0:6952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939731968 00000100:00100000:0.0:1782727357.114342:0:6952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1782727357.114349:0:6952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7df61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1869324939731840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782727357.114378:0:6952:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1782727357.114423:0:6952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7df61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1869324939731840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727357.114430:0:6952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1782727357.114447:0:6952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1782727357.114453:0:6952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7df61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1869324939731968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782727357.114467:0:6952:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1782727357.114568:0:6952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7df61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1869324939731968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727357.114574:0:6952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1782727357.114591:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782727357.114594:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1782727357.114615:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c7df61180 x1869324939731968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727373 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727357.114631:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7df61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869324939731968:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1782727357.114639:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c7df60380 x1869324939731840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727373 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727357.114648:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7df60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869324939731840:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782727357.116226:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7df60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c71e9f0f-6441-4b9b-bc96-153ab9250801:3444:1869324939732096:0@lo:400:kworker.0 00000100:00100000:0.0:1782727357.116278:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727357.116322:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782727357.116329:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7df61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869324939732224:0@lo:400:kworker.0 00000100:00100000:2.0:1782727357.116343:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939732096 00000100:00100000:2.0:1782727357.116349:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939732096 00000100:00100000:0.0:1782727357.116355:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727357.116384:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1782727357.116393:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fdb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:3444:x1869324939732096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727357.116449:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fdb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:3444:x1869324939732096:12345-0@lo:400:kworker.0 Request processed in 57us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727357.116455:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1782727357.116490:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7df60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3443:1869324939732480:0@lo:400:kworker.0 00000100:00100000:2.0:1782727357.116513:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727357.116530:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782727357.116534:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7df62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3443:1869324939732352:0@lo:400:kworker.0 00000100:00100000:2.0:1782727357.116554:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727357.116579:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939732224 00000100:00100000:2.0:1782727357.116583:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939732224 00000100:00100000:2.0:1782727357.116602:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939732480 00000100:00100000:2.0:1782727357.116604:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939732480 00000100:00100000:2.0:1782727357.116626:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939732352 00000100:00100000:2.0:1782727357.116629:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939732352 00000100:00100000:2.0:1782727357.116644:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1782727357.116650:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7d6ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869324939732224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727357.116681:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7d6ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869324939732224:12345-0@lo:400:kworker.0 Request processed in 31us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727357.116700:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1782727357.116712:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1782727357.116719:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e13ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1869324939732480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727357.116748:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e13ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1869324939732480:12345-0@lo:400:kworker.0 Request processed in 30us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727357.116754:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1782727357.116765:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1782727357.116770:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e13dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1869324939732352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727357.116794:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e13dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1869324939732352:12345-0@lo:400:kworker.0 Request processed in 24us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727357.116800:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:2.0:1782727357.116820:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782727357.116850:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7df62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3443:1869324939732352:0@lo:400:kworker.0 00000100:00100000:2.0:1782727357.116860:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7df60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3443:1869324939732480:0@lo:400:kworker.0 00000100:00100000:2.0:1782727357.116917:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7df61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869324939732224:0@lo:400:kworker.0 00000100:00100000:2.0:1782727357.116926:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7df60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c71e9f0f-6441-4b9b-bc96-153ab9250801:3444:1869324939732096:0@lo:400:kworker.0 00000100:00100000:3.0:1782727357.447108:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1782727357.447151:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1782727357.447274:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914533376 00000100:00100000:2.0:1782727357.447284:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914533376 00000100:00100000:2.0:1782727357.447346:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 207 00000100:00100000:2.0:1782727357.447358:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fdb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecaf1fda-ff42-4054-9f39-8e142296107b+10:2358:x1869324914533376:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1782727357.447434:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fdb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecaf1fda-ff42-4054-9f39-8e142296107b+10:2358:x1869324914533376:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 78us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727357.447442:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 207 00000100:00100000:0.0:1782727357.447764:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914533504 00000100:00100000:0.0:1782727357.447769:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914533504 00000100:00100000:0.0:1782727357.447832:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 62 00000100:00100000:0.0:1782727357.447839:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e031c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d85bc959-008e-4782-8f39-df709fbb4636+6:2358:x1869324914533504:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1782727357.447919:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e031c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d85bc959-008e-4782-8f39-df709fbb4636+6:2358:x1869324914533504:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 80us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727357.447925:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 62 00000100:00080000:2.0:1782727357.448019:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782727357.882450:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727358.909495:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727359.934561:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727360.953907:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727361.991746:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727362.233289:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e13c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869324939732608:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782727362.233368:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727362.233460:0:6952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939732608 00000100:00100000:2.0:1782727362.233467:0:6952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939732608 00000100:00100000:2.0:1782727362.233535:0:6952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1782727362.233545:0:6952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e13f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324939732608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782727362.233572:0:6952:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1782727362.233615:0:6952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e13f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324939732608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727362.233623:0:6952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1782727362.233651:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1782727362.233681:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c7e13c700 x1869324939732608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727378 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727362.233718:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e13c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869324939732608:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782727362.233736:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7dfc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3444:1869324939733120:0@lo:400:kworker.0 00000100:00100000:2.0:1782727362.233770:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727362.233798:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1782727362.233804:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7dfc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c71e9f0f-6441-4b9b-bc96-153ab9250801:3444:1869324939732736:0@lo:400:kworker.0 00000100:00100000:2.0:1782727362.233849:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727362.233878:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7dfcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869324939733248:0@lo:400:kworker.0 00000100:00100000:2.0:1782727362.233934:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727362.233966:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7dfc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3442:1869324939732864:0@lo:400:kworker.0 00000100:00100000:2.0:1782727362.233988:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727362.234004:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7d6eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869324939733376:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782727362.234029:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727362.234051:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782727362.234057:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7dfc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3442:1869324939732992:0@lo:400:kworker.0 00000100:00100000:2.0:1782727362.234083:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727362.234124:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939733120 00000100:00100000:2.0:1782727362.234128:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939733120 00000100:00100000:2.0:1782727362.234156:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939732864 00000100:00100000:2.0:1782727362.234159:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939732864 00000100:00100000:2.0:1782727362.234169:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939732992 00000100:00100000:2.0:1782727362.234171:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939732992 00000100:00100000:2.0:1782727362.234183:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1782727362.234189:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e13c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1869324939733120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727362.234229:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e13c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1869324939733120:12345-0@lo:400:kworker.0 Request processed in 38us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727362.234245:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1782727362.234261:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1782727362.234266:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e13d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1869324939732864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727362.234316:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e13d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1869324939732864:12345-0@lo:400:kworker.0 Request processed in 50us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727362.234323:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1782727362.234339:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1782727362.234345:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e13e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1869324939732992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727362.234371:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e13e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1869324939732992:12345-0@lo:400:kworker.0 Request processed in 27us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727362.234377:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1782727362.234396:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939732736 00000100:00100000:2.0:1782727362.234399:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939732736 00000100:00100000:2.0:1782727362.234422:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1782727362.234428:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fdb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:3444:x1869324939732736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727362.234464:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fdb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:3444:x1869324939732736:12345-0@lo:400:kworker.0 Request processed in 36us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727362.234471:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1782727362.234474:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7dfc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3442:1869324939732992:0@lo:400:kworker.0 00000100:00100000:1.0:1782727362.234489:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7dfc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3442:1869324939732864:0@lo:400:kworker.0 00000100:00100000:2.0:1782727362.234501:0:9464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939733248 00000100:00100000:2.0:1782727362.234504:0:9464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939733248 00000100:00100000:2.0:1782727362.234541:0:9464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1782727362.234548:0:9464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e13c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324939733248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727362.234577:0:9464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e13c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324939733248:12345-0@lo:400:kworker.0 Request processed in 29us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727362.234583:0:9464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1782727362.234633:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782727362.234636:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782727362.234657:0:6952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939733376 00000100:00100000:2.0:1782727362.234662:0:6952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939733376 00000100:00100000:2.0:1782727362.234686:0:6952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1782727362.234692:0:6952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e13d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1869324939733376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782727362.234709:0:6952:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1782727362.234749:0:6952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e13d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1869324939733376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727362.234755:0:6952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1782727362.234791:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c7d6eaa00 x1869324939733376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727378 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727362.234807:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7d6eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869324939733376:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782727362.234834:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7dfc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c71e9f0f-6441-4b9b-bc96-153ab9250801:3444:1869324939732736:0@lo:400:kworker.0 00010000:00080000:2.0:1782727362.234843:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c7dfcf480 x1869324939733248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727362.234851:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7dfcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869324939733248:0@lo:400:kworker.0 00000100:00100000:2.0:1782727362.234859:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7dfc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3444:1869324939733120:0@lo:400:kworker.0 00000100:00100000:0.0:1782727362.565792:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1782727362.565916:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1782727362.566733:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914533632 00000100:00100000:3.0:1782727362.566744:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914533632 00000100:00100000:3.0:1782727362.566799:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 209 00000100:00100000:3.0:1782727362.566809:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fdb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecaf1fda-ff42-4054-9f39-8e142296107b+10:2355:x1869324914533632:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1782727362.566919:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fdb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecaf1fda-ff42-4054-9f39-8e142296107b+10:2355:x1869324914533632:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 111us (1002us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727362.566927:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 209 00000100:00100000:2.0:1782727362.570270:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914533760 00000100:00100000:2.0:1782727362.570285:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914533760 00000100:00100000:2.0:1782727362.570420:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 66 00000100:00100000:2.0:1782727362.570431:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7d6eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d85bc959-008e-4782-8f39-df709fbb4636+6:2355:x1869324914533760:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1782727362.570518:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7d6eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d85bc959-008e-4782-8f39-df709fbb4636+6:2355:x1869324914533760:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 88us (4736us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727362.570527:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 66 00000100:00080000:3.0:1782727362.573207:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782727363.001271:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727364.028007:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727365.051612:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782727365.501283:0:10587:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: - need MDS1_VERSION <= 2.16.61-1-g89cf292a8c2 (34682451 <= 34618625) for LU-18938, skip 360 00010000:00010000:0.0:1782727366.073194:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727367.102862:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782727367.161836:0:10636:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: - need MDS1_VERSION < v2_14_55-100-g8a84c7f9c7 (34682451 < 34486116) for LU-14927, skip 0f 00000100:00100000:2.0:1782727367.353079:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782727367.353106:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e13d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869324939733504:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782727367.353172:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727367.353228:0:6952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939733504 00000100:00100000:2.0:1782727367.353235:0:6952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939733504 00000100:00100000:2.0:1782727367.353286:0:6952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1782727367.353293:0:6952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e13fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1869324939733504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782727367.353321:0:6952:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1782727367.353362:0:6952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e13fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1869324939733504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727367.353369:0:6952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1782727367.353583:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782727367.353689:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7dfce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c71e9f0f-6441-4b9b-bc96-153ab9250801:3444:1869324939733632:0@lo:400:kworker.0 00000100:00100000:1.0:1782727367.353725:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727367.353752:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7dfcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3444:1869324939734144:0@lo:400:kworker.0 00000100:00100000:1.0:1782727367.353777:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727367.353796:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1782727367.353802:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7dfce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869324939733760:0@lo:400:kworker.0 00000100:00100000:1.0:1782727367.353824:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727367.353840:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e030700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869324939734272:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782727367.353861:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727367.353901:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7dfcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869324939734016:0@lo:400:kworker.0 00000100:00100000:1.0:1782727367.353924:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727367.353943:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782727367.353948:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7dfcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3443:1869324939733888:0@lo:400:kworker.0 00000100:00100000:1.0:1782727367.353969:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727367.353994:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939733632 00000100:00100000:1.0:1782727367.353999:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939733632 00010000:00080000:2.0:1782727367.354545:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c7e13d180 x1869324939733504/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727383 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727367.354567:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e13d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869324939733504:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782727367.354606:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1782727367.354617:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fd13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:3444:x1869324939733632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727367.354668:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fd13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:3444:x1869324939733632:12345-0@lo:400:kworker.0 Request processed in 54us (942us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727367.354675:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1782727367.354708:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939734144 00000100:00100000:1.0:1782727367.354712:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939734144 00000100:00100000:2.0:1782727367.354738:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7dfce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c71e9f0f-6441-4b9b-bc96-153ab9250801:3444:1869324939733632:0@lo:400:kworker.0 00000100:00100000:1.0:1782727367.354745:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939733760 00000100:00100000:1.0:1782727367.354748:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939733760 00000100:00100000:1.0:1782727367.354767:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939733888 00000100:00100000:1.0:1782727367.354770:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939733888 00000100:00080000:3.0:1782727367.354784:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782727367.354784:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1782727367.354790:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dfcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1869324939734144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727367.354832:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dfcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1869324939734144:12345-0@lo:400:kworker.0 Request processed in 41us (1053us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727367.354838:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1782727367.354849:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1782727367.354855:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dfc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869324939733760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727367.354879:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dfc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869324939733760:12345-0@lo:400:kworker.0 Request processed in 25us (1055us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727367.354904:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1782727367.354915:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1782727367.354921:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dfc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1869324939733888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727367.354956:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dfc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1869324939733888:12345-0@lo:400:kworker.0 Request processed in 35us (985us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727367.354961:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1782727367.354981:0:6950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939734016 00000100:00100000:1.0:1782727367.354984:0:6950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939734016 00000100:00100000:1.0:1782727367.355010:0:6950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1782727367.355016:0:6950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dfc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3443:x1869324939734016:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1782727367.355123:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782727367.355143:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7dfcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3443:1869324939733888:0@lo:400:kworker.0 00000100:00100000:1.0:1782727367.356016:0:6950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dfc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3443:x1869324939734016:12345-0@lo:400:kworker.0 Request processed in 997us (2088us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727367.356024:0:6950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1782727367.356141:0:6952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939734272 00000100:00100000:1.0:1782727367.356146:0:6952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939734272 00000100:00100000:1.0:1782727367.356177:0:6952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1782727367.356195:0:6952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dfc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324939734272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782727367.356220:0:6952:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1782727367.356256:0:6952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dfc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324939734272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (2393us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727367.356262:0:6952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1782727367.356378:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c7dfcca80 x1869324939734016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727367.356391:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7dfcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869324939734016:0@lo:400:kworker.0 00000100:00100000:2.0:1782727367.356684:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7dfce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869324939733760:0@lo:400:kworker.0 00010000:00080000:2.0:1782727367.356697:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c7e030700 x1869324939734272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727383 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727367.356710:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e030700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869324939734272:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782727367.356722:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7dfcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3444:1869324939734144:0@lo:400:kworker.0 00000100:00100000:0.0:1782727367.689199:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1782727367.689248:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1782727367.689335:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914533888 00000100:00100000:3.0:1782727367.689345:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914533888 00000100:00100000:3.0:1782727367.689411:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 211 00000100:00100000:3.0:1782727367.689420:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fd13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecaf1fda-ff42-4054-9f39-8e142296107b+10:2356:x1869324914533888:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1782727367.689507:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fd13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecaf1fda-ff42-4054-9f39-8e142296107b+10:2356:x1869324914533888:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 87us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727367.689515:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 211 00000100:00100000:1.0:1782727367.689859:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914534016 00000100:00100000:1.0:1782727367.689864:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914534016 00000100:00100000:1.0:1782727367.689952:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 70 00000100:00100000:1.0:1782727367.689959:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7d6eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d85bc959-008e-4782-8f39-df709fbb4636+6:2356:x1869324914534016:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1782727367.689995:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7d6eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d85bc959-008e-4782-8f39-df709fbb4636+6:2356:x1869324914534016:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 37us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727367.690128:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 70 00000100:00080000:3.0:1782727367.690246:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782727368.121152:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727369.160252:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782727369.245297:0:10684:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: - need OST1_VERSION < v2_17_50-410-gbd8e7b9555 (34682451 < 34681754) for LU-12550, skip 216 00010000:00010000:0.0:1782727370.169104:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782727370.977810:0:10732:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 42a 42c 42b 118c 118d 407 119i 216 817 411a 00010000:00010000:1.0:1782727371.193464:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727372.219748:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727372.473242:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e0e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c71e9f0f-6441-4b9b-bc96-153ab9250801:3442:1869324939734400:0@lo:400:kworker.0 00000100:00100000:0.0:1782727372.473320:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727372.473369:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e0e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3442:1869324939734912:0@lo:400:kworker.0 00000100:00100000:0.0:1782727372.473398:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727372.473426:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1782727372.473432:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e0e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3442:1869324939734528:0@lo:400:kworker.0 00000100:00100000:0.0:1782727372.473454:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727372.473474:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e0e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869324939735040:0@lo:400:kworker.0 00000100:00100000:0.0:1782727372.473498:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727372.473524:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e0e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3444:1869324939734656:0@lo:400:kworker.0 00000100:00100000:0.0:1782727372.473546:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727372.473572:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782727372.473577:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e0e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869324939734784:0@lo:400:kworker.0 00000100:00100000:0.0:1782727372.473598:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727372.473627:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939734912 00000100:00100000:0.0:1782727372.473635:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939734912 00000100:00100000:0.0:1782727372.473681:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939734528 00000100:00100000:0.0:1782727372.473684:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939734528 00000100:00100000:0.0:1782727372.473696:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939734656 00000100:00100000:0.0:1782727372.473698:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939734656 00000100:00100000:0.0:1782727372.473713:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1782727372.473721:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1869324939734912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727372.473773:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1869324939734912:12345-0@lo:400:kworker.0 Request processed in 52us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727372.473780:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1782727372.473798:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1782727372.473813:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1869324939734528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727372.473842:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1869324939734528:12345-0@lo:400:kworker.0 Request processed in 31us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727372.473848:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1782727372.473860:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1782727372.473866:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869324939734656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727372.473930:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869324939734656:12345-0@lo:400:kworker.0 Request processed in 63us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727372.473935:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1782727372.473953:0:9464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939735040 00000100:00100000:0.0:1782727372.473956:0:9464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939735040 00000100:00100000:0.0:1782727372.473980:0:9464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939734784 00000100:00100000:0.0:1782727372.473983:0:9464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939734784 00000100:00100000:0.0:1782727372.474082:0:9464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1782727372.474089:0:9464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3442:x1869324939735040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727372.474122:0:9464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3442:x1869324939735040:12345-0@lo:400:kworker.0 Request processed in 32us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727372.474127:0:9464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1782727372.474138:0:9464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1782727372.474144:0:9464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324939734784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727372.474170:0:9464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324939734784:12345-0@lo:400:kworker.0 Request processed in 26us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727372.474175:0:9464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1782727372.474207:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c7e0e4000 x1869324939734784/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727372.474222:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e0e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869324939734784:0@lo:400:kworker.0 00000100:00100000:0.0:1782727372.474242:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e0e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3444:1869324939734656:0@lo:400:kworker.0 00000100:00100000:0.0:1782727372.474272:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e0e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3442:1869324939734528:0@lo:400:kworker.0 00010000:00080000:0.0:1782727372.474283:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c7e0e5500 x1869324939735040/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727372.474293:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e0e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869324939735040:0@lo:400:kworker.0 00000100:00100000:0.0:1782727372.474303:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e0e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3442:1869324939734912:0@lo:400:kworker.0 00000100:00100000:1.0:1782727372.474388:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939734400 00000100:00100000:1.0:1782727372.474393:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939734400 00000100:00100000:1.0:1782727372.474432:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1782727372.474438:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fd12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:3442:x1869324939734400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727372.474478:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fd12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:3442:x1869324939734400:12345-0@lo:400:kworker.0 Request processed in 40us (1159us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727372.474484:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1782727372.474530:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e0e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c71e9f0f-6441-4b9b-bc96-153ab9250801:3442:1869324939734400:0@lo:400:kworker.0 00000100:00080000:3.0:1782727372.474814:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782727372.474819:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782727372.474821:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782727372.475183:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782727372.475197:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7df22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869324939735168:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782727372.475239:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727372.475311:0:6952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939735168 00000100:00100000:1.0:1782727372.475316:0:6952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939735168 00000100:00100000:1.0:1782727372.475354:0:6952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1782727372.475371:0:6952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e033480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324939735168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782727372.475395:0:6952:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1782727372.475437:0:6952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e033480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324939735168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727372.475444:0:6952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:1.0:1782727372.475475:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c7df22300 x1869324939735168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727388 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727372.475489:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7df22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869324939735168:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782727372.476196:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782727372.476209:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e0e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869324939735296:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782727372.476247:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727372.476364:0:6952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939735296 00000100:00100000:3.0:1782727372.476369:0:6952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939735296 00000100:00100000:3.0:1782727372.476410:0:6952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1782727372.476418:0:6952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e13d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324939735296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782727372.476438:0:6952:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1782727372.476483:0:6952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e13d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324939735296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727372.476490:0:6952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1782727372.476561:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c7e0e5880 x1869324939735296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727388 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727372.476596:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e0e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869324939735296:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1782727372.672757:0:10780:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: skipping tests SLOW=no: 27m 60i 64b 68 71 135 136 230d 300o 842 51c 51e 834 00000100:00100000:0.0:1782727372.813157:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1782727372.813219:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1782727372.813306:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914534272 00000100:00100000:3.0:1782727372.813315:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914534272 00000100:00100000:3.0:1782727372.813385:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 74 00000100:00100000:3.0:1782727372.813396:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d85bc959-008e-4782-8f39-df709fbb4636+6:2358:x1869324914534272:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1782727372.813464:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d85bc959-008e-4782-8f39-df709fbb4636+6:2358:x1869324914534272:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 69us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727372.813470:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 74 00000100:00100000:1.0:1782727372.813533:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914534144 00000100:00100000:1.0:1782727372.813538:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914534144 00000100:00100000:1.0:1782727372.813583:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 213 00000100:00100000:1.0:1782727372.813590:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fd10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecaf1fda-ff42-4054-9f39-8e142296107b+10:2358:x1869324914534144:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1782727372.813614:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fd10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecaf1fda-ff42-4054-9f39-8e142296107b+10:2358:x1869324914534144:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 26us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727372.813620:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 213 00000100:00080000:0.0:1782727372.813722:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782727373.241564:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727374.265229:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782727374.532323:0:10829:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity: start setup 06:02:52 (1782727372) === 00010000:00010000:0.0:1782727375.289124:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727376.314801:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727377.337808:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727377.595825:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782727377.595857:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e030000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869324939735424:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782727377.595952:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727377.596019:0:6952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939735424 00000100:00100000:3.0:1782727377.596026:0:6952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939735424 00000100:00100000:3.0:1782727377.596087:0:6952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1782727377.596098:0:6952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e031880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1869324939735424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782727377.596136:0:6952:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1782727377.596186:0:6952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e031880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1869324939735424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727377.596194:0:6952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:3.0:1782727377.596215:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1782727377.596246:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c7e030000 x1869324939735424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727393 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727377.596269:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e030000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869324939735424:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782727377.596353:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e031500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869324939735680:0@lo:400:kworker.0 00000100:00100000:3.0:1782727377.596382:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727377.596403:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782727377.596408:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e032680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3444:1869324939735808:0@lo:400:kworker.0 00000100:00100000:3.0:1782727377.596429:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727377.596457:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939735680 00000100:00100000:3.0:1782727377.596461:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939735680 00000100:00100000:3.0:1782727377.596489:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939735808 00000100:00100000:3.0:1782727377.596492:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939735808 00000100:00100000:3.0:1782727377.596539:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1782727377.596546:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e032300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869324939735680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727377.596584:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e032300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869324939735680:12345-0@lo:400:kworker.0 Request processed in 38us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727377.596591:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1782727377.596603:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1782727377.596609:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e030a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869324939735808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727377.596635:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e030a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869324939735808:12345-0@lo:400:kworker.0 Request processed in 26us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727377.596649:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:3.0:1782727377.596670:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782727377.596690:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e032680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3444:1869324939735808:0@lo:400:kworker.0 00000100:00100000:3.0:1782727377.596700:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e031500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869324939735680:0@lo:400:kworker.0 00000100:00100000:3.0:1782727377.596716:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e030000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c71e9f0f-6441-4b9b-bc96-153ab9250801:3443:1869324939735552:0@lo:400:kworker.0 00000100:00100000:3.0:1782727377.596747:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727377.596771:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e033b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869324939736064:0@lo:400:kworker.0 00000100:00100000:3.0:1782727377.596793:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727377.596812:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782727377.596818:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e031180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3443:1869324939735936:0@lo:400:kworker.0 00000100:00100000:3.0:1782727377.596836:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727377.596859:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939735552 00000100:00100000:3.0:1782727377.596862:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939735552 00000100:00100000:3.0:1782727377.596922:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1782727377.596929:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fd10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:3443:x1869324939735552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727377.596963:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fd10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:3443:x1869324939735552:12345-0@lo:400:kworker.0 Request processed in 34us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727377.596968:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1782727377.596996:0:9464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939736064 00000100:00100000:3.0:1782727377.596999:0:9464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939736064 00000100:00100000:3.0:1782727377.597030:0:9464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1782727377.597036:0:9464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e031500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3443:x1869324939736064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727377.597068:0:9464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e031500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3443:x1869324939736064:12345-0@lo:400:kworker.0 Request processed in 32us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727377.597073:0:9464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1782727377.597099:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782727377.597106:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939735936 00000100:00100000:3.0:1782727377.597108:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939735936 00000100:00100000:3.0:1782727377.597132:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1782727377.597138:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e032680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1869324939735936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727377.597169:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e032680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1869324939735936:12345-0@lo:400:kworker.0 Request processed in 32us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727377.597174:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:3.0:1782727377.597188:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782727377.597368:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e031180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3443:1869324939735936:0@lo:400:kworker.0 00000100:00100000:3.0:1782727377.597377:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e030000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c71e9f0f-6441-4b9b-bc96-153ab9250801:3443:1869324939735552:0@lo:400:kworker.0 00010000:00080000:3.0:1782727377.597390:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c7e033b80 x1869324939736064/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727377.597399:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e033b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869324939736064:0@lo:400:kworker.0 00000100:00100000:3.0:1782727377.600212:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782727377.600244:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e0e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869324939736192:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782727377.600319:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727377.600374:0:6952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939736192 00000100:00100000:3.0:1782727377.600382:0:6952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939736192 00000100:00100000:3.0:1782727377.600428:0:6952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1782727377.600436:0:6952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e033b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324939736192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782727377.600470:0:6952:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1782727377.601830:0:6952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e033b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324939736192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1305us (1422us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727377.601843:0:6952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1782727377.601927:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c7e0e4700 x1869324939736192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727393 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727377.601961:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e0e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869324939736192:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782727377.927013:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1782727377.927072:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1782727377.927106:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914534528 00000100:00100000:2.0:1782727377.927117:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914534528 00000100:00100000:2.0:1782727377.927183:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 78 00000100:00100000:2.0:1782727377.927194:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e13e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d85bc959-008e-4782-8f39-df709fbb4636+6:2355:x1869324914534528:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1782727377.927273:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e13e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d85bc959-008e-4782-8f39-df709fbb4636+6:2355:x1869324914534528:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 82us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727377.927280:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 78 00000100:00100000:2.0:1782727377.927307:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914534400 00000100:00100000:2.0:1782727377.927311:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914534400 00000100:00100000:2.0:1782727377.927337:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 215 00000100:00100000:2.0:1782727377.927344:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fd11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecaf1fda-ff42-4054-9f39-8e142296107b+10:2355:x1869324914534400:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1782727377.927374:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fd11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecaf1fda-ff42-4054-9f39-8e142296107b+10:2355:x1869324914534400:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 31us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727377.927380:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 215 00000100:00080000:2.0:1782727377.927407:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782727378.361094:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727379.386210:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727380.409139:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782727380.997318:0:11022:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg260-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:0.0:1782727381.433365:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727382.458088:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727382.713069:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e030000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869324939736320:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782727382.713140:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727382.713743:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7df22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c71e9f0f-6441-4b9b-bc96-153ab9250801:3442:1869324939736448:0@lo:400:kworker.0 00000100:00100000:1.0:1782727382.713784:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727382.713872:0:6952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939736320 00000100:00100000:3.0:1782727382.713881:0:6952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939736320 00000100:00100000:3.0:1782727382.713958:0:6952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1782727382.713966:0:6952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e031180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324939736320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782727382.713997:0:6952:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1782727382.714052:0:6952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e031180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324939736320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (912us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727382.714059:0:6952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1782727382.714082:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7df20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3443:1869324939736576:0@lo:400:kworker.0 00000100:00100000:3.0:1782727382.714173:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727382.715084:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7df23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869324939736960:0@lo:400:kworker.0 00000100:00100000:1.0:1782727382.715129:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727382.715165:0:6950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939736960 00000100:00100000:1.0:1782727382.715170:0:6950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939736960 00000100:00100000:3.0:1782727382.715422:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e0e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869324939737088:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782727382.715451:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1782727382.715492:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782727382.715496:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782727382.715521:0:6953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939737088 00000100:00100000:3.0:1782727382.715525:0:6953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939737088 00000100:00100000:3.0:1782727382.715543:0:6953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1782727382.715551:0:6953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e033800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3443:x1869324939737088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782727382.715577:0:6953:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1782727382.715617:0:6953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e033800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3443:x1869324939737088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727382.715623:0:6953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1782727382.715653:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939736576 00000100:00100000:3.0:1782727382.715656:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939736576 00000100:00100000:3.0:1782727382.715681:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1782727382.715688:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e030e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1869324939736576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727382.715721:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e030e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1869324939736576:12345-0@lo:400:kworker.0 Request processed in 34us (1548us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727382.715728:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1782727382.715746:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939736448 00000100:00100000:3.0:1782727382.715749:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939736448 00000100:00100000:3.0:1782727382.715777:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1782727382.715782:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fd12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:3442:x1869324939736448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727382.715824:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fd12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:3442:x1869324939736448:12345-0@lo:400:kworker.0 Request processed in 41us (2040us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727382.715829:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1782727382.715862:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7df22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3444:1869324939736704:0@lo:400:kworker.0 00000100:00100000:3.0:1782727382.715901:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727382.715921:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782727382.715929:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7df21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3444:1869324939736832:0@lo:400:kworker.0 00000100:00100000:3.0:1782727382.715950:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727382.715973:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939736704 00000100:00100000:3.0:1782727382.715976:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939736704 00000100:00100000:3.0:1782727382.716000:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939736832 00000100:00100000:3.0:1782727382.716002:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939736832 00000100:00100000:3.0:1782727382.716015:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1782727382.716020:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e032a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869324939736704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727382.716051:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e032a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869324939736704:12345-0@lo:400:kworker.0 Request processed in 30us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727382.716065:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1782727382.716078:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1782727382.716084:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e032d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1869324939736832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727382.716110:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e032d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1869324939736832:12345-0@lo:400:kworker.0 Request processed in 27us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727382.716115:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:3.0:1782727382.716132:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782727382.716158:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7df21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3444:1869324939736832:0@lo:400:kworker.0 00000100:00100000:3.0:1782727382.716168:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7df22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3444:1869324939736704:0@lo:400:kworker.0 00010000:00080000:3.0:1782727382.716200:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c7e030000 x1869324939736320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727398 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727382.716232:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e030000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869324939736320:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1782727382.716263:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c7e0e7480 x1869324939737088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727398 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727382.716276:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e0e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869324939737088:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782727382.716286:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7df20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3443:1869324939736576:0@lo:400:kworker.0 00000100:00100000:1.0:1782727382.716961:0:6950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1782727382.716976:0:6950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7df21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3442:x1869324939736960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727382.717024:0:6950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7df21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3442:x1869324939736960:12345-0@lo:400:kworker.0 Request processed in 54us (1894us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727382.723958:0:6950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1782727382.724361:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7df22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c71e9f0f-6441-4b9b-bc96-153ab9250801:3442:1869324939736448:0@lo:400:kworker.0 00010000:00080000:0.0:1782727382.725127:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c7df23b80 x1869324939736960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727382.725142:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7df23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869324939736960:0@lo:400:kworker.0 00000100:00100000:0.0:1782727383.047954:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1782727383.048014:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914534656 00000100:00100000:0.0:1782727383.048022:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1782727383.048026:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914534656 00000100:00100000:3.0:1782727383.048100:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 217 00000100:00100000:3.0:1782727383.048112:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fd11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecaf1fda-ff42-4054-9f39-8e142296107b+10:2356:x1869324914534656:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1782727383.048189:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fd11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecaf1fda-ff42-4054-9f39-8e142296107b+10:2356:x1869324914534656:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 78us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727383.048211:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 217 00000100:00100000:1.0:1782727383.048214:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914534784 00000100:00100000:1.0:1782727383.048221:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914534784 00000100:00100000:1.0:1782727383.048284:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 82 00000100:00100000:1.0:1782727383.048293:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d85bc959-008e-4782-8f39-df709fbb4636+6:2355:x1869324914534784:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1782727383.048327:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d85bc959-008e-4782-8f39-df709fbb4636+6:2355:x1869324914534784:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 36us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727383.048334:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 82 00000100:00080000:0.0:1782727383.048383:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782727383.482106:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727384.509510:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727385.529372:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727386.567227:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727387.580351:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727387.834055:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e030000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869324939737216:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782727387.834153:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727387.834242:0:6953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939737216 00000100:00100000:3.0:1782727387.834249:0:6953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939737216 00000100:00100000:3.0:1782727387.834312:0:6953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1782727387.834322:0:6953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e030380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324939737216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782727387.834353:0:6953:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1782727387.834451:0:6953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e030380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324939737216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727387.834460:0:6953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:3.0:1782727387.834484:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1782727387.834517:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c7e030000 x1869324939737216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727403 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727387.834536:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e030000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869324939737216:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782727387.835631:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e0e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869324939737344:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782727387.835678:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727387.837322:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e030000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c71e9f0f-6441-4b9b-bc96-153ab9250801:3442:1869324939737472:0@lo:400:kworker.0 00000100:00100000:3.0:1782727387.837378:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727387.837436:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782727387.837443:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e033100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3442:1869324939737600:0@lo:400:kworker.0 00000100:00100000:3.0:1782727387.837568:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727387.837603:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939737472 00000100:00100000:3.0:1782727387.837610:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939737472 00000100:00100000:3.0:1782727387.837652:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1782727387.837661:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fd10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:3442:x1869324939737472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727387.837729:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fd10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:3442:x1869324939737472:12345-0@lo:400:kworker.0 Request processed in 68us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727387.837737:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1782727387.837769:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939737600 00000100:00100000:3.0:1782727387.837773:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939737600 00000100:00100000:3.0:1782727387.837796:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1782727387.837802:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1869324939737600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727387.837834:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1869324939737600:12345-0@lo:400:kworker.0 Request processed in 32us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727387.837840:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1782727387.837903:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e033100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3442:1869324939737600:0@lo:400:kworker.0 00000100:00100000:3.0:1782727387.837916:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e030000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c71e9f0f-6441-4b9b-bc96-153ab9250801:3442:1869324939737472:0@lo:400:kworker.0 00000100:00100000:3.0:1782727387.837938:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e030700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3444:1869324939737728:0@lo:400:kworker.0 00000100:00100000:3.0:1782727387.837961:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727387.837981:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782727387.837986:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e0f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3444:1869324939737856:0@lo:400:kworker.0 00000100:00100000:3.0:1782727387.838005:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727387.838025:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939737728 00000100:00100000:3.0:1782727387.838028:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939737728 00000100:00100000:3.0:1782727387.838050:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939737856 00000100:00100000:3.0:1782727387.838052:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939737856 00000100:00100000:3.0:1782727387.838065:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1782727387.838070:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869324939737728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727387.838098:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869324939737728:12345-0@lo:400:kworker.0 Request processed in 28us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727387.838113:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1782727387.838123:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1782727387.838128:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1869324939737856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727387.838151:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1869324939737856:12345-0@lo:400:kworker.0 Request processed in 23us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727387.838156:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:3.0:1782727387.838171:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782727387.838188:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e0f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3444:1869324939737856:0@lo:400:kworker.0 00000100:00100000:3.0:1782727387.838196:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e030700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3444:1869324939737728:0@lo:400:kworker.0 00000100:00100000:0.0:1782727387.847925:0:6953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939737344 00000100:00100000:0.0:1782727387.847936:0:6953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939737344 00000100:00100000:1.0:1782727387.848062:0:6953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1782727387.848071:0:6953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7df23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324939737344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782727387.848095:0:6953:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1782727387.848158:0:6953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7df23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324939737344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (12480us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727387.848172:0:6953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:0.0:1782727387.848714:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1782727387.848874:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c7e0e4e00 x1869324939737344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727403 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727387.848988:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e0e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869324939737344:0@lo:13:osp-pre-1-0.0 00000020:00000004:2.0:1782727387.881107:0:11284:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1782727387.881260:0:11284:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1782727388.174157:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1782727388.174207:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1782727388.174295:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914534912 00000100:00100000:3.0:1782727388.174305:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914534912 00000100:00100000:3.0:1782727388.174375:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 219 00000100:00100000:3.0:1782727388.174548:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fd11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecaf1fda-ff42-4054-9f39-8e142296107b+10:2356:x1869324914534912:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1782727388.174674:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fd11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecaf1fda-ff42-4054-9f39-8e142296107b+10:2356:x1869324914534912:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 130us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727388.174681:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 219 00000100:00100000:1.0:1782727388.176728:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914535040 00000100:00100000:1.0:1782727388.176740:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914535040 00000100:00100000:1.0:1782727388.176810:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 86 00000100:00100000:1.0:1782727388.176821:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e13ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d85bc959-008e-4782-8f39-df709fbb4636+6:2356:x1869324914535040:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1782727388.176925:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e13ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d85bc959-008e-4782-8f39-df709fbb4636+6:2356:x1869324914535040:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 106us (2717us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727388.176932:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 86 00000100:00080000:0.0:1782727388.177729:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782727388.601245:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727389.627711:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1782727389.863826:0:11381:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1782727389.864212:0:11381:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1782727390.656173:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727391.673117:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1782727391.787700:0:11478:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1782727391.787992:0:11478:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1782727392.697095:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727392.953362:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e0f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c71e9f0f-6441-4b9b-bc96-153ab9250801:3442:1869324939737984:0@lo:400:kworker.0 00000100:00100000:3.0:1782727392.953492:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727392.953555:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e0f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3442:1869324939738496:0@lo:400:kworker.0 00000100:00100000:3.0:1782727392.953607:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727392.953636:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1782727392.953643:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e0f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3442:1869324939738112:0@lo:400:kworker.0 00000100:00100000:3.0:1782727392.953668:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727392.953688:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e0f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869324939738624:0@lo:400:kworker.0 00000100:00100000:3.0:1782727392.953714:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727392.953747:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e0f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3444:1869324939738240:0@lo:400:kworker.0 00000100:00100000:3.0:1782727392.953773:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727392.953790:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782727392.953796:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e0f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869324939738368:0@lo:400:kworker.0 00000100:00100000:3.0:1782727392.953834:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727392.953870:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939737984 00000100:00100000:3.0:1782727392.953880:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939737984 00000100:00100000:3.0:1782727392.953965:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1782727392.953976:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fd12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:3442:x1869324939737984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727392.954036:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fd12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:3442:x1869324939737984:12345-0@lo:400:kworker.0 Request processed in 61us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727392.954046:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1782727392.954084:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939738496 00000100:00100000:3.0:1782727392.954088:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939738496 00000100:00100000:3.0:1782727392.954123:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939738112 00000100:00100000:3.0:1782727392.954126:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939738112 00000100:00100000:3.0:1782727392.954137:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939738240 00000100:00100000:3.0:1782727392.954139:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939738240 00000100:00100000:3.0:1782727392.954153:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1782727392.954159:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1869324939738496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727392.954192:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1869324939738496:12345-0@lo:400:kworker.0 Request processed in 34us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727392.954206:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1782727392.954218:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1782727392.954223:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1869324939738112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727392.954252:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1869324939738112:12345-0@lo:400:kworker.0 Request processed in 29us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727392.954260:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1782727392.954270:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1782727392.954276:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869324939738240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727392.954307:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869324939738240:12345-0@lo:400:kworker.0 Request processed in 31us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727392.954313:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1782727392.954336:0:6949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939738624 00000100:00100000:3.0:1782727392.954340:0:6949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939738624 00000100:00100000:3.0:1782727392.954367:0:6949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939738368 00000100:00100000:3.0:1782727392.954370:0:6949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939738368 00000100:00100000:3.0:1782727392.954403:0:6949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1782727392.954410:0:6949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3442:x1869324939738624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727392.954442:0:6949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3442:x1869324939738624:12345-0@lo:400:kworker.0 Request processed in 33us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727392.954449:0:6949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1782727392.954459:0:6949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1782727392.954465:0:6949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324939738368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727392.954491:0:6949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324939738368:12345-0@lo:400:kworker.0 Request processed in 26us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727392.954497:0:6949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1782727392.954560:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e0f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3442:1869324939738112:0@lo:400:kworker.0 00010000:00080000:3.0:1782727392.954577:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c7e0f7100 x1869324939738624/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727392.954588:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e0f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869324939738624:0@lo:400:kworker.0 00000100:00100000:3.0:1782727392.954599:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e0f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c71e9f0f-6441-4b9b-bc96-153ab9250801:3442:1869324939737984:0@lo:400:kworker.0 00000100:00100000:3.0:1782727392.954609:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e0f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3442:1869324939738496:0@lo:400:kworker.0 00000100:00080000:3.0:1782727392.954636:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782727392.954640:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782727392.954643:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1782727392.954657:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c7e0f6d80 x1869324939738368/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727392.954666:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e0f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869324939738368:0@lo:400:kworker.0 00000100:00100000:3.0:1782727392.954677:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e0f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3444:1869324939738240:0@lo:400:kworker.0 00000100:00100000:3.0:1782727392.955135:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e0e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869324939738752:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782727392.955174:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727392.955243:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782727392.955250:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e13ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869324939738880:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782727392.955273:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727392.966552:0:6953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939738752 00000100:00100000:0.0:1782727392.966574:0:6953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939738752 00000100:00100000:0.0:1782727392.966660:0:6953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939738880 00000100:00100000:0.0:1782727392.966664:0:6953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939738880 00000100:00100000:0.0:1782727392.966688:0:6953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1782727392.966701:0:6953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324939738752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782727392.966747:0:6953:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1782727392.966880:0:6953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324939738752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 180us (11703us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727392.966915:0:6953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1782727392.966935:0:6953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1782727392.966942:0:6953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324939738880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782727392.966959:0:6953:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1782727392.966990:0:6953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324939738880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (11716us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727392.966996:0:6953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1782727392.967054:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c7e13ce00 x1869324939738880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727408 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727392.967078:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e13ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869324939738880:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1782727392.967094:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c7e0e7800 x1869324939738752/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727408 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727392.967107:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e0e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869324939738752:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782727393.283587:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1782727393.283679:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1782727393.283765:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914535296 00000100:00100000:1.0:1782727393.283789:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914535296 00000100:00100000:1.0:1782727393.283875:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 90 00000100:00100000:1.0:1782727393.283910:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e13f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d85bc959-008e-4782-8f39-df709fbb4636+6:2358:x1869324914535296:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1782727393.284010:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e13f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d85bc959-008e-4782-8f39-df709fbb4636+6:2358:x1869324914535296:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 124us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727393.284018:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 90 00000100:00080000:2.0:1782727393.284156:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782727393.285537:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914535168 00000100:00100000:3.0:1782727393.285551:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914535168 00000100:00100000:3.0:1782727393.285611:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 221 00000100:00100000:3.0:1782727393.285622:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fd13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecaf1fda-ff42-4054-9f39-8e142296107b+10:2358:x1869324914535168:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1782727393.285710:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fd13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecaf1fda-ff42-4054-9f39-8e142296107b+10:2358:x1869324914535168:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 90us (2140us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727393.285730:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 221 00010000:00010000:3.0:1782727393.721110:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1782727393.955547:0:11575:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1782727393.955859:0:11575:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1782727394.748108:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727395.770022:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727396.793043:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782727397.612718:0:11720:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1782727397.817160:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727398.073278:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7dfcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869324939739392:0@lo:400:kworker.0 00000100:00100000:2.0:1782727398.073359:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727398.073421:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782727398.073428:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e13c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3445:1869324939739264:0@lo:400:kworker.0 00000100:00100000:2.0:1782727398.073455:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727398.073527:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e13ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c71e9f0f-6441-4b9b-bc96-153ab9250801:3442:1869324939739008:0@lo:400:kworker.0 00000100:00100000:3.0:1782727398.073562:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727398.073594:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7dfce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3442:1869324939739520:0@lo:400:kworker.0 00000100:00100000:3.0:1782727398.073618:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727398.073638:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1782727398.073644:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e13ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3442:1869324939739136:0@lo:400:kworker.0 00000100:00100000:3.0:1782727398.073666:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727398.073683:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7dfcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869324939739648:0@lo:400:kworker.0 00000100:00100000:3.0:1782727398.073704:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727398.073734:0:6949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939739392 00000100:00100000:3.0:1782727398.073742:0:6949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939739392 00000100:00100000:3.0:1782727398.073790:0:6949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939739648 00000100:00100000:3.0:1782727398.073793:0:6949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939739648 00000100:00100000:3.0:1782727398.073814:0:6949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1782727398.073822:0:6949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dfcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324939739392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727398.073872:0:6949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dfcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324939739392:12345-0@lo:400:kworker.0 Request processed in 50us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727398.073879:0:6949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1782727398.073917:0:6949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1782727398.073924:0:6949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3442:x1869324939739648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727398.073959:0:6949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3442:x1869324939739648:12345-0@lo:400:kworker.0 Request processed in 35us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727398.073980:0:6949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1782727398.073996:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939739264 00000100:00100000:3.0:1782727398.073999:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939739264 00000100:00100000:3.0:1782727398.074018:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939739520 00000100:00100000:3.0:1782727398.074021:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939739520 00000100:00100000:3.0:1782727398.074032:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939739136 00000100:00100000:3.0:1782727398.074034:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939739136 00000100:00100000:3.0:1782727398.074046:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1782727398.074053:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dfce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3445:x1869324939739264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727398.074084:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dfce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3445:x1869324939739264:12345-0@lo:400:kworker.0 Request processed in 32us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727398.074090:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1782727398.074100:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1782727398.074105:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1869324939739520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727398.074130:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1869324939739520:12345-0@lo:400:kworker.0 Request processed in 25us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727398.074135:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1782727398.074145:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1782727398.074151:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1869324939739136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727398.074173:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1869324939739136:12345-0@lo:400:kworker.0 Request processed in 23us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727398.074178:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:3.0:1782727398.074205:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782727398.074209:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782727398.074210:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782727398.074243:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e13ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3442:1869324939739136:0@lo:400:kworker.0 00010000:00080000:3.0:1782727398.074267:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c7dfcca80 x1869324939739648/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727414 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727398.074278:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7dfcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869324939739648:0@lo:400:kworker.0 00000100:00100000:3.0:1782727398.074289:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7dfce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3442:1869324939739520:0@lo:400:kworker.0 00000100:00100000:3.0:1782727398.074318:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e13c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3445:1869324939739264:0@lo:400:kworker.0 00010000:00080000:3.0:1782727398.074327:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c7dfcc700 x1869324939739392/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727414 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727398.074347:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7dfcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869324939739392:0@lo:400:kworker.0 00000100:00100000:0.0:1782727398.074607:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782727398.074618:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e0e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869324939739776:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782727398.074648:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727398.074678:0:6953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939739776 00000100:00100000:0.0:1782727398.074683:0:6953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939739776 00000100:00100000:0.0:1782727398.074714:0:6953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1782727398.074720:0:6953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324939739776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782727398.074743:0:6953:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1782727398.074788:0:6953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324939739776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727398.074795:0:6953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:0.0:1782727398.074826:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c7e0e7800 x1869324939739776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727414 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727398.074840:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e0e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869324939739776:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782727398.075311:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939739008 00000100:00100000:2.0:1782727398.075316:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939739008 00000100:00100000:2.0:1782727398.075371:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1782727398.075378:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fd10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:3442:x1869324939739008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727398.075421:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fd10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:3442:x1869324939739008:12345-0@lo:400:kworker.0 Request processed in 44us (1858us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727398.075427:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1782727398.075477:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e13ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c71e9f0f-6441-4b9b-bc96-153ab9250801:3442:1869324939739008:0@lo:400:kworker.0 00000100:00100000:1.0:1782727398.076576:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782727398.076592:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e0f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869324939739904:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782727398.076634:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727398.076723:0:6953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939739904 00000100:00100000:2.0:1782727398.076729:0:6953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939739904 00000100:00100000:2.0:1782727398.076768:0:6953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1782727398.076776:0:6953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7df22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324939739904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782727398.076800:0:6953:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1782727398.076850:0:6953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7df22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324939739904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727398.076871:0:6953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1782727398.077008:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c7e0f7800 x1869324939739904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727414 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727398.077025:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e0f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869324939739904:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782727398.405194:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1782727398.405242:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1782727398.405354:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914535424 00000100:00100000:3.0:1782727398.405364:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914535424 00000100:00100000:3.0:1782727398.405425:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 223 00000100:00100000:3.0:1782727398.405435:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fd12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecaf1fda-ff42-4054-9f39-8e142296107b+10:2356:x1869324914535424:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1782727398.405509:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fd12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecaf1fda-ff42-4054-9f39-8e142296107b+10:2356:x1869324914535424:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 75us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727398.405517:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 223 00000100:00100000:0.0:1782727398.406080:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914535552 00000100:00100000:0.0:1782727398.406086:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914535552 00000100:00100000:0.0:1782727398.406177:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 94 00000100:00100000:0.0:1782727398.406185:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dfcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d85bc959-008e-4782-8f39-df709fbb4636+6:2356:x1869324914535552:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1782727398.406238:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dfcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d85bc959-008e-4782-8f39-df709fbb4636+6:2356:x1869324914535552:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 54us (995us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727398.406245:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 94 00000100:00080000:3.0:1782727398.408574:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782727398.841317:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727399.866113:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727400.892043:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782727401.561742:0:11867:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd4677aa20 20000000:00000080:2.0:1782727401.561760:0:11867:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff921c7e0e8800 uarg=0000000000000000 20000000:01000000:2.0:1782727401.561803:0:11867:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1782727401.561809:0:11867:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1782727401.561813:0:11867:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1782727401.563348:0:11868:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1782727401.563510:0:11867:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1782727401.570581:0:11867:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1782727401.570824:0:11867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff921c429d4200/0x14a47870ee88cc76 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727401.570846:0:11867:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff921c7a3e1000/0x14a47870ee88cc45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf0ab expref: 9 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727401.570853:0:11867:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff921c43a22400/0x14a47870ee88cc53 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x14a47870ee88cc4c expref: 18 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727401.570859:0:11867:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff921c429d4800/0x14a47870ee88cc61 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x14a47870ee88cc5a expref: 18 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727401.570864:0:11867:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff921c43a22e00/0x14a47870ee88cc6f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x14a47870ee88cc68 expref: 18 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727401.570870:0:11867:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff921c429d4200/0x14a47870ee88cc76 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727401.571286:0:11867:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff921c43a22e00/0x14a47870ee88cc6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x14a47870ee88cc68 expref: 18 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727401.571328:0:11867:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff921c43a22e00/0x14a47870ee88cc6f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x14a47870ee88cc68 expref: 18 pid: 5943 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727401.571343:0:11867:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7dfce680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11867:1869324939740032:0@lo:104: 00000100:00100000:2.0:1782727401.571405:0:11867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782727401.571498:0:11867:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff921c429d4800/0x14a47870ee88cc61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x14a47870ee88cc5a expref: 18 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727401.571506:0:11867:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff921c429d4800/0x14a47870ee88cc61 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x14a47870ee88cc5a expref: 18 pid: 5943 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727401.571515:0:11867:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7df60380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11867:1869324939740160:0@lo:104: 00000100:00100000:2.0:1782727401.571536:0:11867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782727401.571610:0:11867:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff921c43a22400/0x14a47870ee88cc53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x14a47870ee88cc4c expref: 18 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727401.571619:0:11867:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff921c43a22400/0x14a47870ee88cc53 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x14a47870ee88cc4c expref: 18 pid: 5944 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727401.571628:0:11867:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7df60000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11867:1869324939740288:0@lo:104: 00000100:00100000:2.0:1782727401.571653:0:11867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727401.571685:0:5933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939740032 00000100:00100000:1.0:1782727401.571692:0:5933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939740032 00000100:00100000:1.0:1782727401.571730:0:5933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939740160 00000100:00100000:1.0:1782727401.571733:0:5933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939740160 00000100:00100000:1.0:1782727401.571748:0:5933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1782727401.571756:0:5933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dfcca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c71e9f0f-6441-4b9b-bc96-153ab9250801+4:11867:x1869324939740032:12345-0@lo:104: 00010000:00010000:1.0:1782727401.571774:0:5933:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.160@tcp lock: ffff921c4151d200/0x14a47870ee88cc68 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x14a47870ee88cc6f expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727401.571824:0:5933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782727401.571830:0:5933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dfcca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c71e9f0f-6441-4b9b-bc96-153ab9250801+4:11867:x1869324939740032:12345-0@lo:104: Request processed in 74us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727401.571836:0:5933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1782727401.571856:0:5933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1782727401.571862:0:5933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7df61180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c71e9f0f-6441-4b9b-bc96-153ab9250801+3:11867:x1869324939740160:12345-0@lo:104: 00010000:00010000:1.0:1782727401.571869:0:5933:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.160@tcp lock: ffff921c429d4600/0x14a47870ee88cc5a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x14a47870ee88cc61 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727401.571941:0:5933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1782727401.571947:0:5933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7df61180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c71e9f0f-6441-4b9b-bc96-153ab9250801+3:11867:x1869324939740160:12345-0@lo:104: Request processed in 85us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727401.571953:0:5933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:1.0:1782727401.571971:0:8027:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782727401.571977:0:8027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff921c4151d200/0x14a47870ee88cc68 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x14a47870ee88cc6f expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727401.571983:0:8027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c4151d200 already unused, calling callback (ffffffffc12b0c20) 10000000:00010000:1.0:1782727401.571986:0:8027:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff921c4151d200/0x14a47870ee88cc68 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x14a47870ee88cc6f expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727401.571994:0:8027:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff921c4151d200/0x14a47870ee88cc68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x14a47870ee88cc6f expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782727401.572001:0:8027:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff921c4151d200/0x14a47870ee88cc68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x14a47870ee88cc6f expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782727401.572013:0:8027:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1782727401.572042:0:8027:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff921c4151d200/0x14a47870ee88cc68 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x14a47870ee88cc6f expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727401.572048:0:8027:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782727401.572068:0:8027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff921c4151d200/0x14a47870ee88cc68 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x14a47870ee88cc6f expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727401.572075:0:8027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff921c4151d200/0x14a47870ee88cc68 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x14a47870ee88cc6f expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727401.572086:0:8027:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782727401.572089:0:8027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff921c429d4600/0x14a47870ee88cc5a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x14a47870ee88cc61 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727401.572094:0:8027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c429d4600 already unused, calling callback (ffffffffc12b0c20) 10000000:00010000:1.0:1782727401.572097:0:8027:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff921c429d4600/0x14a47870ee88cc5a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x14a47870ee88cc61 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727401.572103:0:8027:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff921c429d4600/0x14a47870ee88cc5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x14a47870ee88cc61 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782727401.572109:0:8027:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff921c429d4600/0x14a47870ee88cc5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x14a47870ee88cc61 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782727401.572114:0:8027:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1782727401.572124:0:8027:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff921c429d4600/0x14a47870ee88cc5a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x14a47870ee88cc61 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727401.572129:0:8027:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782727401.572140:0:8027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff921c429d4600/0x14a47870ee88cc5a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x14a47870ee88cc61 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727401.572147:0:8027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff921c429d4600/0x14a47870ee88cc5a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x14a47870ee88cc61 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727401.572156:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727401.572157:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727401.572159:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727401.572177:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7df20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c71e9f0f-6441-4b9b-bc96-153ab9250801:3442:1869324939740416:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782727401.572205:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727401.572224:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782727401.572229:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7df22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c71e9f0f-6441-4b9b-bc96-153ab9250801:3442:1869324939740544:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782727401.572248:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727401.572272:0:5935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939740416 00000100:00100000:1.0:1782727401.572275:0:5935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939740416 00010000:00010000:1.0:1782727401.572290:0:5935:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff921c43a22e00/0x14a47870ee88cc6f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x14a47870ee88cc68 expref: 19 pid: 5943 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727401.572320:0:5935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939740544 00000100:00100000:1.0:1782727401.572322:0:5935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939740544 00010000:00010000:1.0:1782727401.572332:0:5935:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff921c429d4800/0x14a47870ee88cc61 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x14a47870ee88cc5a expref: 20 pid: 5943 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727401.572344:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1782727401.572350:0:5935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5302d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c71e9f0f-6441-4b9b-bc96-153ab9250801+20:3442:x1869324939740416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782727401.572359:0:5935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782727401.572363:0:5935:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff921c43a22e00/0x14a47870ee88cc6f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x14a47870ee88cc68 expref: 20 pid: 5943 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727401.572382:0:5935:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff921c43a22e00/0x14a47870ee88cc6f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x14a47870ee88cc68 expref: 20 pid: 5943 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727401.572397:0:5935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782727401.572423:0:5935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5302d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c71e9f0f-6441-4b9b-bc96-153ab9250801+20:3442:x1869324939740416:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727401.572430:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1782727401.572466:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1782727401.572472:0:5935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7df21180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:3442:x1869324939740544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782727401.572479:0:5935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782727401.572483:0:5935:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff921c429d4800/0x14a47870ee88cc61 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x14a47870ee88cc5a expref: 19 pid: 5943 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727401.572491:0:5935:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff921c429d4800/0x14a47870ee88cc61 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x14a47870ee88cc5a expref: 19 pid: 5943 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727401.572500:0:5935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782727401.572517:0:5935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7df21180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:3442:x1869324939740544:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727401.572523:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1782727401.572559:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7df22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c71e9f0f-6441-4b9b-bc96-153ab9250801:3442:1869324939740544:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782727401.572567:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7df20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c71e9f0f-6441-4b9b-bc96-153ab9250801:3442:1869324939740416:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782727401.572705:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727401.573080:0:5932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939740288 00000100:00100000:3.0:1782727401.573085:0:5932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939740288 00000100:00100000:3.0:1782727401.573106:0:5932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1782727401.573116:0:11867:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff921c7a3e1000/0x14a47870ee88cc45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf0ab expref: 9 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727401.573118:0:5932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7df62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c71e9f0f-6441-4b9b-bc96-153ab9250801+3:11867:x1869324939740288:12345-0@lo:104: 00010000:00010000:3.0:1782727401.573126:0:5932:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.160@tcp lock: ffff921c7a3e0e00/0x14a47870ee88cc4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x14a47870ee88cc53 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727401.573127:0:11867:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff921c7a3e1000/0x14a47870ee88cc45 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf0ab expref: 9 pid: 5943 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727401.573138:0:11867:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7df63b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11867:1869324939740672:192.168.202.60@tcp:104: 00010000:00010000:3.0:1782727401.573215:0:5932:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782727401.573220:0:5932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7df62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c71e9f0f-6441-4b9b-bc96-153ab9250801+3:11867:x1869324939740288:12345-0@lo:104: Request processed in 104us (1567us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727401.573226:0:5932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1782727401.573291:0:11867:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c7667aa80 going to sleep for 11 seconds 00010000:00010000:2.0:1782727401.573321:0:11867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921c43a22e00/0x14a47870ee88cc6f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x14a47870ee88cc68 expref: 18 pid: 5943 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727401.573332:0:11867:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7dfce680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11867:1869324939740032:0@lo:104: 00010000:00010000:2.0:1782727401.573343:0:11867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921c429d4800/0x14a47870ee88cc61 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x14a47870ee88cc5a expref: 17 pid: 5943 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727401.573352:0:11867:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7df60380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11867:1869324939740160:0@lo:104: 00000100:00100000:2.0:1782727401.573359:0:11867:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7df60000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11867:1869324939740288:0@lo:104: 00010000:00010000:0.0:1782727401.574820:0:5937:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782727401.574831:0:5937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff921c7a3e0e00/0x14a47870ee88cc4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x14a47870ee88cc53 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727401.574852:0:5937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c7a3e0e00 already unused, calling callback (ffffffffc12b0c20) 10000000:00010000:0.0:1782727401.574855:0:5937:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff921c7a3e0e00/0x14a47870ee88cc4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x14a47870ee88cc53 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727401.574864:0:5937:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff921c7a3e0e00/0x14a47870ee88cc4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x14a47870ee88cc53 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782727401.574871:0:5937:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff921c7a3e0e00/0x14a47870ee88cc4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x14a47870ee88cc53 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782727401.574875:0:5937:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1782727401.575005:0:5937:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff921c7a3e0e00/0x14a47870ee88cc4c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x14a47870ee88cc53 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727401.575012:0:5937:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782727401.575040:0:5937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff921c7a3e0e00/0x14a47870ee88cc4c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x14a47870ee88cc53 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727401.575046:0:5937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff921c7a3e0e00/0x14a47870ee88cc4c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x14a47870ee88cc53 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727401.575062:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727401.575063:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727401.575065:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727401.575074:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782727401.575092:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e0e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c71e9f0f-6441-4b9b-bc96-153ab9250801:3445:1869324939740800:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782727401.575141:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727401.575232:0:5935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939740800 00000100:00100000:1.0:1782727401.575238:0:5935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939740800 00010000:00010000:1.0:1782727401.575264:0:5935:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff921c43a22400/0x14a47870ee88cc53 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x14a47870ee88cc4c expref: 17 pid: 5944 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727401.575319:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1782727401.575327:0:5935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c71e9f0f-6441-4b9b-bc96-153ab9250801+17:3445:x1869324939740800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782727401.575343:0:5935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782727401.575351:0:5935:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff921c43a22400/0x14a47870ee88cc53 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x14a47870ee88cc4c expref: 17 pid: 5944 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727401.575361:0:5935:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff921c43a22400/0x14a47870ee88cc53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x14a47870ee88cc4c expref: 17 pid: 5944 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727401.575373:0:5935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921c43a22400/0x14a47870ee88cc53 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x14a47870ee88cc4c expref: 17 pid: 5944 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727401.575384:0:5935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782727401.575417:0:5935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c71e9f0f-6441-4b9b-bc96-153ab9250801+16:3445:x1869324939740800:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727401.575425:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1782727401.575460:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e0e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c71e9f0f-6441-4b9b-bc96-153ab9250801:3445:1869324939740800:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782727401.580601:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1782727401.581393:0:5934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914535680 00000100:00100000:1.0:1782727401.581404:0:5934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914535680 00010000:00010000:1.0:1782727401.581442:0:5934:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff921c7a3e1000/0x14a47870ee88cc45 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf0ab expref: 10 pid: 5943 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727401.581492:0:5934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 28 00000100:00100000:1.0:1782727401.581501:0:5934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ecaf1fda-ff42-4054-9f39-8e142296107b+10:2358:x1869324914535680:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782727401.581518:0:5934:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782727401.581524:0:5934:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff921c7a3e1000/0x14a47870ee88cc45 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf0ab expref: 10 pid: 5943 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727401.581561:0:5934:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff921c7a3e1000/0x14a47870ee88cc45 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf0ab expref: 10 pid: 5943 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727401.581582:0:5934:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff921c429d4200/0x14a47870ee88cc76 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727401.581591:0:5934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921c429d4200/0x14a47870ee88cc76 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727401.581609:0:5934:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff921c429d4200/0x14a47870ee88cc76 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727401.581617:0:5934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff921c429d4200/0x14a47870ee88cc76 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727401.581624:0:5934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff921c429d4200/0x14a47870ee88cc76 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727401.581632:0:5934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff921c429d4200/0x14a47870ee88cc76 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727401.581638:0:5934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c429d4200 already unused, calling callback (ffffffffc0c98cf0) 00010000:00010000:1.0:1782727401.581643:0:5934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff921c429d4200/0x14a47870ee88cc76 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727401.581651:0:5934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff921c429d4200/0x14a47870ee88cc76 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727401.581661:0:5934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff921c429d4200/0x14a47870ee88cc76 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727401.581681:0:5934:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782727401.581739:0:5934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ecaf1fda-ff42-4054-9f39-8e142296107b+10:2358:x1869324914535680:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 238us (1148us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727401.581748:0:5934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 28 00010000:00010000:2.0:1782727401.582108:0:11867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921c7a3e1000/0x14a47870ee88cc45 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf0ab expref: 9 pid: 5943 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727401.582124:0:11867:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7df63b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11867:1869324939740672:192.168.202.60@tcp:104: 00010000:00010000:2.0:1782727401.582155:0:11867:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff921c429d4200/0x14a47870ee88cc76 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727401.582185:0:11867:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff921c429d4200/0x14a47870ee88cc76 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727401.582192:0:11867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff921c429d4200/0x14a47870ee88cc76 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727401.582200:0:11867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921c429d4200/0x14a47870ee88cc76 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727401.913139:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727402.637141:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1782727402.637555:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914535808 00000100:00100000:3.0:1782727402.637566:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914535808 00000100:00100000:3.0:1782727402.637618:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 224 00000100:00100000:3.0:1782727402.637628:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fd13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecaf1fda-ff42-4054-9f39-8e142296107b+9:5458:x1869324914535808:12345-192.168.202.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782727402.637645:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727402.637664:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921c4151ca00/0x14a47870ee88cc7d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1752a87bbfbdf0b2 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727402.637692:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921c4151ca00/0x14a47870ee88cc7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf0b2 expref: 10 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727402.637704:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921c4151ca00/0x14a47870ee88cc7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf0b2 expref: 10 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727402.637713:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c4151ca00, rc 0) 00000100:00100000:3.0:1782727402.637775:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fd13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecaf1fda-ff42-4054-9f39-8e142296107b+10:5458:x1869324914535808:12345-192.168.202.60@tcp:101:ll_cfg_requeue.0 Request processed in 147us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727402.637782:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 224 00000100:00100000:0.0:1782727402.641116:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1782727402.641187:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914535936 00000100:00100000:1.0:1782727402.641196:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914535936 00000100:00100000:1.0:1782727402.641250:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 225 00000100:00100000:1.0:1782727402.641259:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fd11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecaf1fda-ff42-4054-9f39-8e142296107b+10:5458:x1869324914535936:12345-192.168.202.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782727402.641424:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fd11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecaf1fda-ff42-4054-9f39-8e142296107b+10:5458:x1869324914535936:12345-192.168.202.60@tcp:501:ll_cfg_requeue.0 Request processed in 165us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727402.641433:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 225 00000100:00100000:3.0:1782727402.646588:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1782727402.646690:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914536064 00000100:00100000:0.0:1782727402.646705:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914536064 00000100:00100000:0.0:1782727402.646774:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 226 00000100:00100000:0.0:1782727402.646786:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6dd3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecaf1fda-ff42-4054-9f39-8e142296107b+10:5458:x1869324914536064:12345-192.168.202.60@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782727402.646958:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6dd3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecaf1fda-ff42-4054-9f39-8e142296107b+10:5458:x1869324914536064:12345-192.168.202.60@tcp:503:ll_cfg_requeue.0 Request processed in 174us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727402.646967:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 226 00010000:00010000:0.0:1782727402.939250:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727403.193227:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e0e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869324939740928:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782727403.193319:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:1.0:1782727403.193403:0:5946:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1782727403.193407:0:5946:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff921c7d8c0800 from 7 10000000:01000000:1.0:1782727403.193410:0:5946:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782727403.193442:0:5946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff921c43a22c00/0x14a47870ee88cc84 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727403.193454:0:5946:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff921c43a22c00/0x14a47870ee88cc84 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727403.193465:0:5946:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff921c43a22c00/0x14a47870ee88cc84 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727403.193482:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7df22680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939741056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782727403.193540:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727403.193563:0:5946:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c46441780 going to sleep for 11 seconds 00000100:00100000:1.0:1782727403.193581:0:6953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939740928 00000100:00100000:1.0:1782727403.193588:0:6953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939740928 00000100:00100000:1.0:1782727403.193639:0:6953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1782727403.193649:0:6953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7df20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324939740928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782727403.193676:0:6953:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1782727403.193716:0:6953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7df20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324939740928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727403.193723:0:6953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1782727403.193748:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939741056 00000100:00100000:1.0:1782727403.193752:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939741056 00000100:00100000:1.0:1782727403.193776:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1782727403.193783:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6dd3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+16:5946:x1869324939741056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782727403.193792:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727403.193804:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921c43a22800/0x14a47870ee88cc8b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x14a47870ee88cc84 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727403.193825:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921c43a22800/0x14a47870ee88cc8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x14a47870ee88cc84 expref: 17 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727403.193835:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921c43a22800/0x14a47870ee88cc8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x14a47870ee88cc84 expref: 17 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727403.193844:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c43a22800, rc 0) 00000100:00100000:1.0:1782727403.193870:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6dd3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+17:5946:x1869324939741056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727403.193876:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00080000:1.0:1782727403.193923:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1782727403.193953:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c7e0e4380 x1869324939740928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727419 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727403.193970:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e0e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869324939740928:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782727403.193998:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7df22680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939741056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782727403.194011:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff921c43a22c00/0x14a47870ee88cc84 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88cc8b expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727403.194020:0:5946:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff921c43a22c00/0x14a47870ee88cc84 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x14a47870ee88cc8b expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727403.194074:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7df22680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939741184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782727403.194101:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727403.194116:0:5946:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c46441780 going to sleep for 11 seconds 00000100:00100000:1.0:1782727403.194129:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939741184 00000100:00100000:1.0:1782727403.194132:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939741184 00000100:00100000:1.0:1782727403.194152:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1782727403.194157:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6dd3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+17:5946:x1869324939741184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782727403.194263:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6dd3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+17:5946:x1869324939741184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 105us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727403.194269:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1782727403.194312:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7df22680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939741184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782727403.194339:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7df22680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939741312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782727403.194378:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727403.194392:0:5946:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c46441780 going to sleep for 11 seconds 00000100:00100000:1.0:1782727403.194409:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939741312 00000100:00100000:1.0:1782727403.194413:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939741312 00000100:00100000:1.0:1782727403.194433:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1782727403.194439:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6dd3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+17:5946:x1869324939741312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782727403.194510:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6dd3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+17:5946:x1869324939741312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727403.194516:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1782727403.194556:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7df22680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939741312:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1782727403.195208:0:11924:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1782727403.195269:0:5946:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1782727403.195285:0:5946:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782727403.195307:0:5946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff921c43a22c00/0x14a47870ee88cc84 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88cc8b expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727403.195315:0:5946:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff921c43a22c00/0x14a47870ee88cc84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88cc8b expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782727403.195325:0:5946:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1782727403.195327:0:5946:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff921c45e6f800 from 7 10000000:01000000:1.0:1782727403.195330:0:5946:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782727403.195357:0:5946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff921c43a22a00/0x14a47870ee88cc92 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727403.195364:0:5946:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff921c43a22a00/0x14a47870ee88cc92 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727403.195373:0:5946:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff921c43a22a00/0x14a47870ee88cc92 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727403.195389:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7df22680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939741440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782727403.195436:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727403.195455:0:5946:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c464419c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782727403.195472:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939741440 00000100:00100000:1.0:1782727403.195477:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939741440 00000100:00100000:1.0:1782727403.195506:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1782727403.195513:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6dd3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+17:5946:x1869324939741440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782727403.195523:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727403.195534:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921c43a22400/0x14a47870ee88cc99 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x14a47870ee88cc92 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727403.195553:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921c43a22400/0x14a47870ee88cc99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x14a47870ee88cc92 expref: 18 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727403.195562:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921c43a22400/0x14a47870ee88cc99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x14a47870ee88cc92 expref: 18 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727403.195570:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c43a22400, rc 0) 00000100:00100000:1.0:1782727403.195600:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6dd3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+18:5946:x1869324939741440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727403.195607:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1782727403.195643:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7df22680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939741440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782727403.195653:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff921c43a22a00/0x14a47870ee88cc92 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88cc99 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727403.195662:0:5946:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff921c43a22a00/0x14a47870ee88cc92 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x14a47870ee88cc99 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727403.195702:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7df22680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939741568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782727403.195731:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727403.195745:0:5946:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c464419c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782727403.195758:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939741568 00000100:00100000:1.0:1782727403.195761:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939741568 00000100:00100000:1.0:1782727403.195782:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1782727403.195788:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6dd3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+18:5946:x1869324939741568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782727403.195876:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6dd3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+18:5946:x1869324939741568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 86us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727403.195903:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1782727403.195933:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7df22680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939741568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782727403.195957:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7df22680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939741696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782727403.195992:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727403.196004:0:5946:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c464419c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782727403.196015:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939741696 00000100:00100000:1.0:1782727403.196018:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939741696 00000100:00100000:1.0:1782727403.196038:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1782727403.196044:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6dd3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+18:5946:x1869324939741696:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782727403.196111:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6dd3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+18:5946:x1869324939741696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 66us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727403.196118:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1782727403.196155:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7df22680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939741696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782727403.197977:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7df63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3442:1869324939741824:0@lo:400:kworker.0 00000100:00100000:2.0:1782727403.198072:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727403.198119:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782727403.198126:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7df60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3442:1869324939741952:0@lo:400:kworker.0 00000100:00100000:2.0:1782727403.198161:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727403.198194:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7df62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869324939742208:0@lo:400:kworker.0 00000100:00100000:2.0:1782727403.198221:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727403.198239:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782727403.198245:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7df60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3445:1869324939742080:0@lo:400:kworker.0 00000100:00100000:2.0:1782727403.198279:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727403.198338:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939741824 00000100:00100000:2.0:1782727403.198345:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939741824 00000100:00100000:2.0:1782727403.198378:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939741952 00000100:00100000:2.0:1782727403.198381:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939741952 00000100:00100000:2.0:1782727403.198401:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939742080 00000100:00100000:2.0:1782727403.198404:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939742080 00000100:00100000:2.0:1782727403.198419:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1782727403.198426:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dfce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1869324939741824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727403.198476:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dfce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1869324939741824:12345-0@lo:400:kworker.0 Request processed in 50us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727403.198484:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1782727403.198512:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1782727403.198519:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1869324939741952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727403.198547:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1869324939741952:12345-0@lo:400:kworker.0 Request processed in 28us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727403.198552:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1782727403.198564:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1782727403.198569:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1869324939742080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727403.198599:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1869324939742080:12345-0@lo:400:kworker.0 Request processed in 29us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727403.198611:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1782727403.198634:0:6949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939742208 00000100:00100000:2.0:1782727403.198637:0:6949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939742208 00000100:00100000:2.0:1782727403.198665:0:6949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1782727403.198671:0:6949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324939742208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727403.198702:0:6949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324939742208:12345-0@lo:400:kworker.0 Request processed in 31us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727403.198708:0:6949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1782727403.198725:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782727403.198729:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782727403.198764:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7df60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3445:1869324939742080:0@lo:400:kworker.0 00010000:00080000:2.0:1782727403.198776:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c7df62300 x1869324939742208/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727419 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727403.198787:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7df62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869324939742208:0@lo:400:kworker.0 00000100:00100000:2.0:1782727403.198817:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7df60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3442:1869324939741952:0@lo:400:kworker.0 00000100:00100000:2.0:1782727403.198827:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7df63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3442:1869324939741824:0@lo:400:kworker.0 00000100:00100000:0.0:1782727403.200445:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782727403.200963:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e0e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869324939742336:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782727403.201022:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727403.201073:0:6953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939742336 00000100:00100000:0.0:1782727403.201081:0:6953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939742336 00000100:00100000:0.0:1782727403.201127:0:6953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1782727403.201136:0:6953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1869324939742336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782727403.201164:0:6953:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1782727403.201204:0:6953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1869324939742336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727403.201211:0:6953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:0.0:1782727403.203671:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c7e0e7100 x1869324939742336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727419 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727403.203713:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e0e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869324939742336:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1782727403.205117:0:11925:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1782727403.214219:0:5946:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1782727403.216404:0:5946:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782727403.216422:0:5946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff921c43a22a00/0x14a47870ee88cc92 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88cc99 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727403.216433:0:5946:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff921c43a22a00/0x14a47870ee88cc92 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88cc99 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727403.216445:0:5946:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1782727403.216447:0:5946:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff921c479c5800 from 7 10000000:01000000:3.0:1782727403.216449:0:5946:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782727403.216489:0:5946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff921c4151d200/0x14a47870ee88cca0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727403.216607:0:5946:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff921c4151d200/0x14a47870ee88cca0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727403.216621:0:5946:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff921c4151d200/0x14a47870ee88cca0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727403.216645:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e0f5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939742464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782727403.216709:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727403.216753:0:5946:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c7d9543c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782727403.216837:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939742464 00000100:00100000:1.0:1782727403.216844:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939742464 00000100:00100000:1.0:1782727403.216916:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1782727403.216925:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6dd3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+18:5946:x1869324939742464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782727403.216953:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727403.216964:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921c43a22e00/0x14a47870ee88cca7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x14a47870ee88cca0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727403.216988:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921c43a22e00/0x14a47870ee88cca7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x14a47870ee88cca0 expref: 19 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727403.216997:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921c43a22e00/0x14a47870ee88cca7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x14a47870ee88cca0 expref: 19 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727403.217005:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c43a22e00, rc 0) 00000100:00100000:1.0:1782727403.217046:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6dd3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:5946:x1869324939742464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727403.217052:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1782727403.217098:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e0f5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939742464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782727403.217111:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff921c4151d200/0x14a47870ee88cca0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88cca7 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727403.217119:0:5946:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff921c4151d200/0x14a47870ee88cca0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x14a47870ee88cca7 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727403.217175:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7df22680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939742592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782727403.217198:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727403.217211:0:5946:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c464410c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782727403.217223:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939742592 00000100:00100000:1.0:1782727403.217226:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939742592 00000100:00100000:1.0:1782727403.217243:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1782727403.217248:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6dd3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:5946:x1869324939742592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782727403.217379:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6dd3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:5946:x1869324939742592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 130us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727403.217386:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1782727403.217416:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7df22680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939742592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782727403.217442:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7df22680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939742720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782727403.217479:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727403.217494:0:5946:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c464410c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782727403.217522:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939742720 00000100:00100000:1.0:1782727403.217526:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939742720 00000100:00100000:1.0:1782727403.217546:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1782727403.217551:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6dd3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:5946:x1869324939742720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782727403.217619:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6dd3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:5946:x1869324939742720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 66us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727403.217625:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1782727403.217662:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7df22680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c71e9f0f-6441-4b9b-bc96-153ab9250801:5946:1869324939742720:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1782727403.218311:0:11926:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1782727403.218364:0:5946:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1782727403.218389:0:5946:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782727403.218397:0:5946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff921c4151d200/0x14a47870ee88cca0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88cca7 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727403.218406:0:5946:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff921c4151d200/0x14a47870ee88cca0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x14a47870ee88cca7 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727403.552864:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1782727403.552924:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1782727403.552967:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914536192 00000100:00100000:0.0:1782727403.552978:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914536192 00000100:00100000:0.0:1782727403.553038:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 236 00000100:00100000:0.0:1782727403.553048:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6dd3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecaf1fda-ff42-4054-9f39-8e142296107b+10:2356:x1869324914536192:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1782727403.553121:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6dd3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecaf1fda-ff42-4054-9f39-8e142296107b+10:2356:x1869324914536192:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 73us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727403.553129:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 236 00000100:00100000:3.0:1782727403.553921:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914536320 00000100:00100000:3.0:1782727403.553928:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914536320 00000100:00100000:3.0:1782727403.553984:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 98 00000100:00100000:3.0:1782727403.553993:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d85bc959-008e-4782-8f39-df709fbb4636+6:2356:x1869324914536320:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1782727403.554040:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d85bc959-008e-4782-8f39-df709fbb4636+6:2356:x1869324914536320:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 49us (1116us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727403.554046:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 98 00000100:00080000:0.0:1782727403.554689:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782727403.961599:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727404.991430:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782727405.961682:0:12065:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg260-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1782727406.018560:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727407.033395:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727408.057039:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727408.313501:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e0d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869324939742976:0@lo:400:kworker.0 00000100:00100000:2.0:1782727408.313635:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727408.314946:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e0d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c71e9f0f-6441-4b9b-bc96-153ab9250801:3443:1869324939742848:0@lo:400:kworker.0 00000100:00100000:3.0:1782727408.315004:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727408.315066:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939742848 00000100:00100000:3.0:1782727408.315073:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939742848 00000100:00100000:3.0:1782727408.315124:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1782727408.315132:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6dd3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:3443:x1869324939742848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727408.315182:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6dd3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:3443:x1869324939742848:12345-0@lo:400:kworker.0 Request processed in 50us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727408.315188:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1782727408.315243:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e0d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3445:1869324939743104:0@lo:400:kworker.0 00000100:00100000:3.0:1782727408.315306:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727408.315329:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939742976 00000100:00100000:3.0:1782727408.315332:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939742976 00000100:00100000:3.0:1782727408.315357:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939743104 00000100:00100000:3.0:1782727408.315360:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939743104 00000100:00100000:3.0:1782727408.315384:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1782727408.315390:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869324939742976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727408.315422:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869324939742976:12345-0@lo:400:kworker.0 Request processed in 31us (1788us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727408.315427:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1782727408.315438:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1782727408.315443:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3445:x1869324939743104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727408.315467:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3445:x1869324939743104:12345-0@lo:400:kworker.0 Request processed in 24us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727408.315472:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1782727408.316000:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e0d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869324939742976:0@lo:400:kworker.0 00000100:00100000:2.0:1782727408.316009:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e0d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869324939743488:0@lo:400:kworker.0 00000100:00100000:1.0:1782727408.316182:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e0d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869324939743232:0@lo:400:kworker.0 00000100:00100000:2.0:1782727408.316239:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727408.316409:0:6951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939743488 00000100:00100000:1.0:1782727408.316415:0:6951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939743488 00000100:00100000:1.0:1782727408.316462:0:6951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1782727408.316469:0:6951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324939743488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727408.316510:0:6951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324939743488:12345-0@lo:400:kworker.0 Request processed in 42us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727408.316518:0:6951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1782727408.316541:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727408.316564:0:6949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939743232 00000100:00100000:1.0:1782727408.316567:0:6949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939743232 00000100:00100000:1.0:1782727408.316589:0:6949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1782727408.316595:0:6949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7df22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3442:x1869324939743232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727408.316629:0:6949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7df22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3442:x1869324939743232:12345-0@lo:400:kworker.0 Request processed in 35us (87us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727408.316635:0:6949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1782727408.316746:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e0d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c71e9f0f-6441-4b9b-bc96-153ab9250801:3443:1869324939742848:0@lo:400:kworker.0 00000100:00100000:3.0:1782727408.316761:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e0d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3443:1869324939743360:0@lo:400:kworker.0 00000100:00100000:3.0:1782727408.316788:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727408.316830:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939743360 00000100:00100000:3.0:1782727408.316834:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939743360 00000100:00100000:3.0:1782727408.316859:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1782727408.316866:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1869324939743360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727408.316949:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1869324939743360:12345-0@lo:400:kworker.0 Request processed in 83us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727408.316956:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1782727408.316984:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e0d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3443:1869324939743360:0@lo:400:kworker.0 00010000:00080000:2.0:1782727408.317333:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c7e0d3480 x1869324939743488/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727408.317350:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e0d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869324939743488:0@lo:400:kworker.0 00000100:00100000:1.0:1782727408.317446:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e0d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3445:1869324939743104:0@lo:400:kworker.0 00010000:00080000:2.0:1782727408.317521:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c7e0d1c00 x1869324939743232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727408.317530:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e0d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869324939743232:0@lo:400:kworker.0 00000100:00080000:0.0:1782727408.327573:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782727408.327581:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782727408.327584:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782727408.327593:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782727408.327614:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e0e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869324939743616:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782727408.327727:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727408.327916:0:6953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939743616 00000100:00100000:0.0:1782727408.327924:0:6953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939743616 00000100:00100000:0.0:1782727408.327968:0:6953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1782727408.327977:0:6953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324939743616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782727408.328003:0:6953:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1782727408.328086:0:6953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324939743616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727408.328093:0:6953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:2.0:1782727408.328280:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c7e0e4380 x1869324939743616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727424 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727408.328299:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e0e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869324939743616:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782727408.328445:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782727408.328455:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e0f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869324939743744:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782727408.328481:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727408.328583:0:6953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939743744 00000100:00100000:3.0:1782727408.328588:0:6953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939743744 00000100:00100000:3.0:1782727408.328620:0:6953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1782727408.328626:0:6953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1869324939743744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782727408.328645:0:6953:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1782727408.328787:0:6953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1869324939743744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 161us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727408.328794:0:6953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:0.0:1782727408.329273:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c7e0f5180 x1869324939743744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727424 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727408.329288:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e0f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869324939743744:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782727408.651497:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1782727408.651562:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1782727408.651681:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914536576 00000100:00100000:3.0:1782727408.651700:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914536576 00000100:00100000:3.0:1782727408.651772:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 102 00000100:00100000:3.0:1782727408.651782:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d85bc959-008e-4782-8f39-df709fbb4636+6:2357:x1869324914536576:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1782727408.651854:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d85bc959-008e-4782-8f39-df709fbb4636+6:2357:x1869324914536576:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 73us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727408.651862:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 102 00000100:00100000:1.0:1782727408.651940:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914536448 00000100:00100000:1.0:1782727408.651944:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914536448 00000100:00100000:1.0:1782727408.651974:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 238 00000100:00100000:1.0:1782727408.651980:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6dd3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecaf1fda-ff42-4054-9f39-8e142296107b+10:2357:x1869324914536448:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1782727408.652013:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6dd3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecaf1fda-ff42-4054-9f39-8e142296107b+10:2357:x1869324914536448:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 32us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727408.652019:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 238 00000100:00080000:0.0:1782727408.652260:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782727409.081226:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727410.111654:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727411.158916:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727412.217492:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782727413.154089:0:12214:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity: finish setup 06:03:30 (1782727410) === 00010000:00010000:0.0:1782727413.241102:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727413.398612:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1782727413.398793:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914536704 00000100:00100000:3.0:1782727413.398804:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914536704 00000100:00100000:3.0:1782727413.399035:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 10 00000100:00100000:3.0:1782727413.399048:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d85bc959-008e-4782-8f39-df709fbb4636+6:7482:x1869324914536704:12345-192.168.202.60@tcp:101:bash.0 00010000:00010000:3.0:1782727413.399068:0:5948:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727413.399108:0:5948:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151c800/0x14a47870ee88ccae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1752a87bbfbdf0b9 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727413.399173:0:5948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151d800/0x14a47870ee88ccb5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727413.399187:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151d800/0x14a47870ee88ccb5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727413.399199:0:5948:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151d800/0x14a47870ee88ccb5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727413.399222:0:5948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151ce00/0x14a47870ee88ccbc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727413.399238:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151ce00/0x14a47870ee88ccbc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727413.399245:0:5948:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151ce00/0x14a47870ee88ccbc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727413.399302:0:5948:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151d800/0x14a47870ee88ccb5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727413.399311:0:5948:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151d800/0x14a47870ee88ccb5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727413.399334:0:5948:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151d800/0x14a47870ee88ccb5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727413.399339:0:5948:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c4151d800 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1782727413.399343:0:5948:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151d800/0x14a47870ee88ccb5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727413.399348:0:5948:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151d800/0x14a47870ee88ccb5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727413.399358:0:5948:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921c5fdb6500) 00010000:00010000:3.0:1782727413.399360:0:5948:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782727413.399363:0:5948:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151d800/0x14a47870ee88ccb5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727413.399367:0:5948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151d800/0x14a47870ee88ccb5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727413.399376:0:5948:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151ce00/0x14a47870ee88ccbc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727413.399380:0:5948:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151ce00/0x14a47870ee88ccbc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727413.399384:0:5948:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151ce00/0x14a47870ee88ccbc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727413.399386:0:5948:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c4151ce00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1782727413.399388:0:5948:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151ce00/0x14a47870ee88ccbc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727413.399397:0:5948:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151ce00/0x14a47870ee88ccbc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727413.399402:0:5948:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x54ef8a6e (ffff921c5fdb6700) 00010000:00010000:3.0:1782727413.399404:0:5948:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782727413.399405:0:5948:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151ce00/0x14a47870ee88ccbc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727413.399408:0:5948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151ce00/0x14a47870ee88ccbc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727413.399431:0:5948:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151c800/0x14a47870ee88ccae lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf0b9 expref: 7 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727413.399437:0:5948:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921c5fdb6500) 00010000:00010000:3.0:1782727413.399438:0:5948:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782727413.399440:0:5948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151c800/0x14a47870ee88ccae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf0b9 expref: 7 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727413.399445:0:5948:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c4151c800, rc 0) 00000100:00100000:3.0:1782727413.399499:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d85bc959-008e-4782-8f39-df709fbb4636+6:7482:x1869324914536704:12345-192.168.202.60@tcp:101:bash.0 Request processed in 455us (897us total) trans 0 rc 301/301 00000100:00080000:0.0:1782727413.399543:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782727413.405423:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 10 00000100:00100000:0.0:1782727413.411616:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1782727413.411707:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914536832 00000100:00100000:2.0:1782727413.411718:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914536832 00000100:00100000:2.0:1782727413.411780:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 11 00000100:00100000:2.0:1782727413.411790:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d85bc959-008e-4782-8f39-df709fbb4636+6:7482:x1869324914536832:12345-192.168.202.60@tcp:101:bash.0 00010000:00010000:2.0:1782727413.411810:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727413.411833:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d4800/0x14a47870ee88ccc3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1752a87bbfbdf0c0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727413.411926:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d4200/0x14a47870ee88ccca lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727413.411940:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d4200/0x14a47870ee88ccca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727413.411971:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d4200/0x14a47870ee88ccca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727413.412035:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d4600/0x14a47870ee88ccd1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727413.412043:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d4600/0x14a47870ee88ccd1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727413.412050:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d4600/0x14a47870ee88ccd1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727413.412110:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d4200/0x14a47870ee88ccca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727413.412117:0:5949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d4200/0x14a47870ee88ccca lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727413.412124:0:5949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d4200/0x14a47870ee88ccca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727413.412129:0:5949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c429d4200 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1782727413.412133:0:5949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d4200/0x14a47870ee88ccca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727413.412139:0:5949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d4200/0x14a47870ee88ccca lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727413.412151:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921c5fdb6500) 00010000:00010000:2.0:1782727413.412154:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782727413.412158:0:5949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d4200/0x14a47870ee88ccca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727413.412171:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d4200/0x14a47870ee88ccca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727413.412185:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d4600/0x14a47870ee88ccd1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727413.412191:0:5949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d4600/0x14a47870ee88ccd1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727413.412196:0:5949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d4600/0x14a47870ee88ccd1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727413.412200:0:5949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c429d4600 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1782727413.412214:0:5949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d4600/0x14a47870ee88ccd1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727413.412220:0:5949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d4600/0x14a47870ee88ccd1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727413.412226:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x77bdd2c7 (ffff921c49dcb900) 00010000:00010000:2.0:1782727413.412229:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782727413.412417:0:5949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d4600/0x14a47870ee88ccd1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727413.412426:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d4600/0x14a47870ee88ccd1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727413.412474:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d4800/0x14a47870ee88ccc3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf0c0 expref: 7 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727413.412496:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921c5fdb6500) 00010000:00010000:2.0:1782727413.412499:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782727413.412503:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d4800/0x14a47870ee88ccc3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf0c0 expref: 7 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727413.412513:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c429d4800, rc 0) 00000100:00100000:2.0:1782727413.412642:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d85bc959-008e-4782-8f39-df709fbb4636+6:7482:x1869324914536832:12345-192.168.202.60@tcp:101:bash.0 Request processed in 852us (1036us total) trans 0 rc 301/301 00000100:00100000:2.0:1782727413.412651:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 11 00000100:00100000:1.0:1782727413.418311:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1782727413.418535:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914536960 00000100:00100000:2.0:1782727413.418545:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914536960 00000100:00100000:2.0:1782727413.418656:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 1 00000100:00100000:2.0:1782727413.418667:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7d6e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d85bc959-008e-4782-8f39-df709fbb4636+6:7482:x1869324914536960:12345-192.168.202.60@tcp:37:bash.0 00000100:00100000:2.0:1782727413.424020:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7d6e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d85bc959-008e-4782-8f39-df709fbb4636+6:7482:x1869324914536960:12345-192.168.202.60@tcp:37:bash.0 Request processed in 5343us (5709us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727413.424035:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 1 00000100:00100000:2.0:1782727413.436156:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e0d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869324939744256:0@lo:400:kworker.0 00000100:00100000:2.0:1782727413.436240:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727413.436304:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1782727413.436311:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e0d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c71e9f0f-6441-4b9b-bc96-153ab9250801:3442:1869324939743872:0@lo:400:kworker.0 00000100:00100000:2.0:1782727413.436344:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727413.436366:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e0d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3442:1869324939744384:0@lo:400:kworker.0 00000100:00100000:2.0:1782727413.436389:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727413.436413:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e0d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869324939744000:0@lo:400:kworker.0 00000100:00100000:2.0:1782727413.436449:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727413.436467:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e0d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869324939744512:0@lo:400:kworker.0 00000100:00100000:2.0:1782727413.436488:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727413.436504:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782727413.436510:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e0d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3444:1869324939744128:0@lo:400:kworker.0 00000100:00100000:2.0:1782727413.436528:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727413.436555:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939744384 00000100:00100000:2.0:1782727413.436562:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939744384 00000100:00100000:2.0:1782727413.436605:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939744000 00000100:00100000:2.0:1782727413.436608:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939744000 00000100:00100000:2.0:1782727413.436619:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939744128 00000100:00100000:2.0:1782727413.436621:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939744128 00000100:00100000:2.0:1782727413.436650:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1782727413.436659:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1869324939744384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727413.436710:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1869324939744384:12345-0@lo:400:kworker.0 Request processed in 51us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727413.436717:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1782727413.436735:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1782727413.436741:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869324939744000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727413.436770:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869324939744000:12345-0@lo:400:kworker.0 Request processed in 30us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727413.436776:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1782727413.436786:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1782727413.436792:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869324939744128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727413.436817:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869324939744128:12345-0@lo:400:kworker.0 Request processed in 25us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727413.436833:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1782727413.436869:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e0d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3444:1869324939744128:0@lo:400:kworker.0 00000100:00100000:2.0:1782727413.436906:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e0d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869324939744000:0@lo:400:kworker.0 00000100:00100000:2.0:1782727413.436938:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e0d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3442:1869324939744384:0@lo:400:kworker.0 00000100:00080000:0.0:1782727413.437737:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782727413.437875:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e0e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869324939744640:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782727413.437955:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727413.438000:0:6951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939744256 00000100:00100000:1.0:1782727413.438006:0:6951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939744256 00000100:00100000:1.0:1782727413.438043:0:6951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939744512 00000100:00100000:1.0:1782727413.438046:0:6951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939744512 00000100:00100000:1.0:1782727413.438068:0:6951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1782727413.438087:0:6951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3442:x1869324939744256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727413.438129:0:6951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3442:x1869324939744256:12345-0@lo:400:kworker.0 Request processed in 54us (1889us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727413.438135:0:6951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1782727413.438151:0:6951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1782727413.438157:0:6951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324939744512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727413.438185:0:6951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324939744512:12345-0@lo:400:kworker.0 Request processed in 28us (1696us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727413.438191:0:6951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1782727413.438223:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782727413.438226:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1782727413.438250:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c7e0d2680 x1869324939744256/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727413.438263:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e0d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869324939744256:0@lo:400:kworker.0 00000100:00100000:0.0:1782727413.438441:0:6953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939744640 00000100:00100000:0.0:1782727413.438445:0:6953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939744640 00000100:00100000:0.0:1782727413.438483:0:6953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1782727413.438490:0:6953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dfc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324939744640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782727413.438512:0:6953:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1782727413.438551:0:6953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dfc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324939744640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727413.438557:0:6953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1782727413.438693:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939743872 00000100:00100000:3.0:1782727413.438697:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939743872 00000100:00100000:3.0:1782727413.438723:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1782727413.438730:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6dd3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:3442:x1869324939743872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727413.438762:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6dd3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:3442:x1869324939743872:12345-0@lo:400:kworker.0 Request processed in 32us (2418us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727413.438778:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00010000:00080000:2.0:1782727413.439048:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c7e0d3b80 x1869324939744512/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727413.439061:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e0d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869324939744512:0@lo:400:kworker.0 00000100:00100000:1.0:1782727413.439757:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782727413.439775:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e0f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869324939744768:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782727413.439821:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1782727413.439879:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c7e0e5880 x1869324939744640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727429 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727413.439953:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e0e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869324939744640:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782727413.439985:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e0d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c71e9f0f-6441-4b9b-bc96-153ab9250801:3442:1869324939743872:0@lo:400:kworker.0 00000100:00100000:0.0:1782727413.440124:0:6953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939744768 00000100:00100000:0.0:1782727413.440130:0:6953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939744768 00000100:00100000:0.0:1782727413.440169:0:6953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1782727413.440177:0:6953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dfc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1869324939744768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782727413.440211:0:6953:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1782727413.440260:0:6953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dfc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1869324939744768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727413.440267:0:6953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:2.0:1782727413.443256:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c7e0f5180 x1869324939744768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727429 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727413.443279:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e0f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869324939744768:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782727413.454517:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1782727413.454630:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914537088 00000100:00100000:2.0:1782727413.454640:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914537088 00000100:00100000:2.0:1782727413.454702:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 12 00000100:00100000:2.0:1782727413.454712:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d85bc959-008e-4782-8f39-df709fbb4636+6:10367:x1869324914537088:12345-192.168.202.60@tcp:101:rm.0 00010000:00010000:2.0:1782727413.454732:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727413.454754:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d4800/0x14a47870ee88ccd8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1752a87bbfbdf0c7 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727413.454821:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d4600/0x14a47870ee88ccdf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727413.454836:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d4600/0x14a47870ee88ccdf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727413.454865:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d4600/0x14a47870ee88ccdf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727413.454927:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d4200/0x14a47870ee88cce6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727413.454937:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d4200/0x14a47870ee88cce6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727413.454944:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d4200/0x14a47870ee88cce6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727413.454986:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d4600/0x14a47870ee88ccdf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727413.454993:0:5949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d4600/0x14a47870ee88ccdf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727413.454998:0:5949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d4600/0x14a47870ee88ccdf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727413.455005:0:5949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c429d4600 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1782727413.455009:0:5949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d4600/0x14a47870ee88ccdf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727413.455016:0:5949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d4600/0x14a47870ee88ccdf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727413.455027:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921c5fdb6500) 00010000:00010000:2.0:1782727413.455031:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782727413.455035:0:5949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d4600/0x14a47870ee88ccdf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727413.455047:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d4600/0x14a47870ee88ccdf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727413.455063:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d4200/0x14a47870ee88cce6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727413.455069:0:5949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d4200/0x14a47870ee88cce6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727413.455087:0:5949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d4200/0x14a47870ee88cce6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727413.455092:0:5949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c429d4200 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1782727413.455095:0:5949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d4200/0x14a47870ee88cce6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727413.455101:0:5949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d4200/0x14a47870ee88cce6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727413.455110:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3d64192e (ffff921c49dcb900) 00010000:00010000:2.0:1782727413.455113:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782727413.455116:0:5949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d4200/0x14a47870ee88cce6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727413.455122:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d4200/0x14a47870ee88cce6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727413.455153:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d4800/0x14a47870ee88ccd8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf0c7 expref: 7 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727413.455172:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921c5fdb6500) 00010000:00010000:2.0:1782727413.455175:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782727413.455179:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d4800/0x14a47870ee88ccd8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf0c7 expref: 7 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727413.455187:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c429d4800, rc 0) 00000100:00100000:2.0:1782727413.455252:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d85bc959-008e-4782-8f39-df709fbb4636+6:10367:x1869324914537088:12345-192.168.202.60@tcp:101:rm.0 Request processed in 542us (746us total) trans 0 rc 301/301 00000100:00100000:2.0:1782727413.455260:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 12 00000100:00100000:1.0:1782727413.565821:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1782727413.566173:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914537344 00000100:00100000:0.0:1782727413.566184:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914537344 00000100:00100000:0.0:1782727413.566279:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 0 00000100:00100000:0.0:1782727413.566306:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dfc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:d85bc959-008e-4782-8f39-df709fbb4636+6:10372:x1869324914537344:12345-192.168.202.60@tcp:700:mkdir.0 00000100:00100000:0.0:1782727413.566392:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dfc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:d85bc959-008e-4782-8f39-df709fbb4636+6:10372:x1869324914537344:12345-192.168.202.60@tcp:700:mkdir.0 Request processed in 88us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727413.566400:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 0 00000100:00100000:1.0:1782727413.566496:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1782727413.569775:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914537216 00000100:00100000:2.0:1782727413.569792:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914537216 00000100:00100000:2.0:1782727413.569872:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 13 00000100:00100000:2.0:1782727413.570065:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c45e40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d85bc959-008e-4782-8f39-df709fbb4636+6:2357:x1869324914537216:12345-192.168.202.60@tcp:41:mkdir.0 00000004:00000024:2.0:1782727413.570176:0:5950:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446338560 avail 1300099072 00000100:00100000:2.0:1782727413.570407:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c45e40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d85bc959-008e-4782-8f39-df709fbb4636+6:2357:x1869324914537216:12345-192.168.202.60@tcp:41:mkdir.0 Request processed in 525us (3910us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727413.570415:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 13 00000100:00100000:1.0:1782727413.571831:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1782727413.571910:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914537600 00000100:00100000:0.0:1782727413.571918:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914537600 00000100:00100000:0.0:1782727413.571967:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 14 00000100:00100000:0.0:1782727413.571976:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c45e43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d85bc959-008e-4782-8f39-df709fbb4636+6:10372:x1869324914537600:12345-192.168.202.60@tcp:36:mkdir.0 00010000:00010000:0.0:1782727413.572024:0:5948:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782727413.572050:0:5948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151c600/0x14a47870ee88cbc0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf096 expref: 6 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.572075:0:5948:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921c5fdb6500) 00010000:00010000:0.0:1782727413.572086:0:5948:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782727413.572148:0:5948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0c00/0x14a47870ee88cced lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.572161:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0c00/0x14a47870ee88cced lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.572170:0:5948:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0c00/0x14a47870ee88cced lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.572183:0:5948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1200/0x14a47870ee88ccf4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.572190:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1200/0x14a47870ee88ccf4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.572224:0:5948:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1200/0x14a47870ee88ccf4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782727413.573208:0:5948:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1782727413.573225:0:5948:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0c00/0x14a47870ee88cced lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.573232:0:5948:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0c00/0x14a47870ee88cced lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.573239:0:5948:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0c00/0x14a47870ee88cced lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.573245:0:5948:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c7a3e0c00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:0.0:1782727413.573249:0:5948:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0c00/0x14a47870ee88cced lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.573255:0:5948:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0c00/0x14a47870ee88cced lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.573265:0:5948:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921c58b4cd00) 00010000:00010000:0.0:1782727413.573268:0:5948:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782727413.573272:0:5948:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0c00/0x14a47870ee88cced lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.573277:0:5948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0c00/0x14a47870ee88cced lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782727413.573294:0:5948:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000df3f7266 reply state 0000000001720fe3 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1200/0x14a47870ee88ccf4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727413.573317:0:5948:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782727413.573690:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c45e43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d85bc959-008e-4782-8f39-df709fbb4636+7:10372:x1869324914537600:12345-192.168.202.60@tcp:36:mkdir.0 Request processed in 1712us (1862us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1782727413.573701:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 14 00000100:00100000:2.0:1782727413.589864:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00010000:00010000:0.0:1782727413.590568:0:3428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1200/0x14a47870ee88ccf4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.590582:0:3428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1200/0x14a47870ee88ccf4 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.590589:0:3428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1200/0x14a47870ee88ccf4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.590595:0:3428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c7a3e1200 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:0.0:1782727413.590600:0:3428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1200/0x14a47870ee88ccf4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.590607:0:3428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1200/0x14a47870ee88ccf4 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.590624:0:3428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff921c58b4c300) 00010000:00010000:0.0:1782727413.590626:0:3428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782727413.590631:0:3428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1200/0x14a47870ee88ccf4 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.590637:0:3428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1200/0x14a47870ee88ccf4 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727413.590701:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914537728 00000100:00100000:1.0:1782727413.590710:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914537728 00000100:00100000:1.0:1782727413.590797:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 15 00000100:00100000:1.0:1782727413.590808:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d85bc959-008e-4782-8f39-df709fbb4636+6:10373:x1869324914537728:12345-192.168.202.60@tcp:101:chmod.0 00010000:00010000:1.0:1782727413.590828:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727413.590849:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c43a22600/0x14a47870ee88ccfb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1752a87bbfbdf0ce expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.591050:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921c43a22200/0x14a47870ee88cd02 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.591063:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c43a22200/0x14a47870ee88cd02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.591074:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c43a22200/0x14a47870ee88cd02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782727413.591115:0:5949:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1782727413.591119:0:5949:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782727413.591162:0:5949:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff921c43a22200/0x14a47870ee88cd02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.591187:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c43a22600/0x14a47870ee88ccfb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf0ce expref: 8 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.591229:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921c43a22200/0x14a47870ee88cd02 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf0ce expref: 7 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.591312:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921c5fda7d00) 00010000:00010000:1.0:1782727413.591314:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782727413.591317:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c43a22200, rc 0) 00000100:00100000:1.0:1782727413.591431:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d85bc959-008e-4782-8f39-df709fbb4636+7:10373:x1869324914537728:12345-192.168.202.60@tcp:101:chmod.0 Request processed in 625us (1575us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727413.591439:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 15 00000100:00100000:3.0:1782727413.595033:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1782727413.595191:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914537984 00000100:00100000:0.0:1782727413.595208:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914537984 00000100:00100000:0.0:1782727413.595334:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 16 00000100:00100000:0.0:1782727413.595343:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d85bc959-008e-4782-8f39-df709fbb4636+7:10373:x1869324914537984:12345-192.168.202.60@tcp:36:chmod.0 00010000:00010000:0.0:1782727413.595393:0:5950:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782727413.595416:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c43a22200/0x14a47870ee88cd02 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf0ce expref: 7 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.595435:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921c5fda7d00) 00010000:00010000:0.0:1782727413.595446:0:5950:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782727413.595473:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1a00/0x14a47870ee88cd09 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.595484:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1a00/0x14a47870ee88cd09 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.595493:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1a00/0x14a47870ee88cd09 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782727413.595821:0:5950:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fd936248 reply state 00000000e2456df1 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1a00/0x14a47870ee88cd09 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727413.595833:0:5950:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1782727413.595840:0:5950:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1782727413.596158:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d85bc959-008e-4782-8f39-df709fbb4636+8:10373:x1869324914537984:12345-192.168.202.60@tcp:36:chmod.0 Request processed in 815us (1131us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1782727413.596167:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 16 00010000:00010000:1.0:1782727413.604821:0:3429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1a00/0x14a47870ee88cd09 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.604840:0:3429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1a00/0x14a47870ee88cd09 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.604849:0:3429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1a00/0x14a47870ee88cd09 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.604856:0:3429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c7a3e1a00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1782727413.604861:0:3429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1a00/0x14a47870ee88cd09 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.604869:0:3429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1a00/0x14a47870ee88cd09 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.604914:0:3429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921c58b4c600) 00010000:00010000:1.0:1782727413.604918:0:3429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782727413.604923:0:3429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1a00/0x14a47870ee88cd09 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.604944:0:3429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1a00/0x14a47870ee88cd09 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727413.630557:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1782727413.630787:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914538112 00000100:00100000:0.0:1782727413.630799:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914538112 00000100:00100000:0.0:1782727413.630865:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 17 00000100:00100000:0.0:1782727413.630874:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e13ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d85bc959-008e-4782-8f39-df709fbb4636+7:10374:x1869324914538112:12345-192.168.202.60@tcp:101:chown.0 00010000:00010000:0.0:1782727413.630965:0:5948:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727413.630988:0:5948:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1200/0x14a47870ee88cd10 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1752a87bbfbdf0d5 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.631053:0:5948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0c00/0x14a47870ee88cd17 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.631067:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0c00/0x14a47870ee88cd17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.631078:0:5948:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0c00/0x14a47870ee88cd17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782727413.631118:0:5948:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1782727413.631122:0:5948:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782727413.631168:0:5948:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0c00/0x14a47870ee88cd17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.631193:0:5948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1200/0x14a47870ee88cd10 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf0d5 expref: 9 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.631220:0:5948:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0c00/0x14a47870ee88cd17 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf0d5 expref: 8 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.631229:0:5948:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921c58b4c300) 00010000:00010000:0.0:1782727413.631232:0:5948:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782727413.631235:0:5948:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c7a3e0c00, rc 0) 00000100:00100000:0.0:1782727413.631288:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e13ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d85bc959-008e-4782-8f39-df709fbb4636+8:10374:x1869324914538112:12345-192.168.202.60@tcp:101:chown.0 Request processed in 414us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727413.631295:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 17 00000100:00100000:2.0:1782727413.643771:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1782727413.644043:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914538240 00000100:00100000:1.0:1782727413.644054:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914538240 00000100:00100000:1.0:1782727413.644116:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 18 00000100:00100000:1.0:1782727413.644126:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d85bc959-008e-4782-8f39-df709fbb4636+8:10374:x1869324914538240:12345-192.168.202.60@tcp:101:chown.0 00010000:00010000:1.0:1782727413.644144:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727413.644178:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c43a22600/0x14a47870ee88cd1e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1752a87bbfbdf0dc expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.644266:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff921c43a22200/0x14a47870ee88cd25 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.644280:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c43a22200/0x14a47870ee88cd25 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.644292:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c43a22200/0x14a47870ee88cd25 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.644330:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669000/0x14a47870ee88cd2c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.644338:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669000/0x14a47870ee88cd2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.644345:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669000/0x14a47870ee88cd2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.644427:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669800/0x14a47870ee88cd33 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.644442:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669800/0x14a47870ee88cd33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.644450:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669800/0x14a47870ee88cd33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782727413.644493:0:5949:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1782727413.644496:0:5949:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782727413.644517:0:5949:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669800/0x14a47870ee88cd33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.644530:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff921c43a22200/0x14a47870ee88cd25 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.644537:0:5949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921c43a22200/0x14a47870ee88cd25 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.644543:0:5949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921c43a22200/0x14a47870ee88cd25 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.644550:0:5949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c43a22200 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1782727413.644553:0:5949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c43a22200/0x14a47870ee88cd25 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.644560:0:5949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c43a22200/0x14a47870ee88cd25 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.644571:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921c58b4c300) 00010000:00010000:1.0:1782727413.644574:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782727413.644579:0:5949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921c43a22200/0x14a47870ee88cd25 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.644595:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c43a22200/0x14a47870ee88cd25 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.644610:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669000/0x14a47870ee88cd2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.644617:0:5949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669000/0x14a47870ee88cd2c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.644622:0:5949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669000/0x14a47870ee88cd2c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.644627:0:5949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c76669000 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1782727413.644630:0:5949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669000/0x14a47870ee88cd2c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.644846:0:5949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669000/0x14a47870ee88cd2c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.644857:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff921c5fda7300) 00010000:00010000:1.0:1782727413.644859:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782727413.644862:0:5949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669000/0x14a47870ee88cd2c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.644868:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669000/0x14a47870ee88cd2c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.644963:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c43a22600/0x14a47870ee88cd1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf0dc expref: 10 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.644978:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669800/0x14a47870ee88cd33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf0dc expref: 9 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.644993:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff921c5fda7c00) 00010000:00010000:1.0:1782727413.644995:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782727413.644998:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c76669800, rc 0) 00000100:00100000:1.0:1782727413.645056:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d85bc959-008e-4782-8f39-df709fbb4636+9:10374:x1869324914538240:12345-192.168.202.60@tcp:101:chown.0 Request processed in 932us (1295us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727413.645063:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 18 00000100:00100000:1.0:1782727413.650675:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1782727413.655848:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914538496 00000100:00100000:2.0:1782727413.655863:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914538496 00000100:00100000:0.0:1782727413.656113:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 19 00000100:00100000:0.0:1782727413.656125:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c45e40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d85bc959-008e-4782-8f39-df709fbb4636+9:10374:x1869324914538496:12345-192.168.202.60@tcp:36:chown.0 00010000:00010000:0.0:1782727413.656186:0:5950:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782727413.656223:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669800/0x14a47870ee88cd33 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf0dc expref: 9 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.656254:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff921c5fda7c00) 00010000:00010000:0.0:1782727413.656267:0:5950:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782727413.656294:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1200/0x14a47870ee88cd3a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.656307:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1200/0x14a47870ee88cd3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.656319:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1200/0x14a47870ee88cd3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782727413.662706:0:5929:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:0.0:1782727413.662811:0:5950:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000036387404 reply state 00000000f5159416 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1200/0x14a47870ee88cd3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727413.662826:0:5950:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1782727413.662838:0:5950:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 4096 00010000:00080000:0.0:1782727413.662967:0:5950:0:(ldlm_lib.c:3443:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1782727413.662986:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c45e40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d85bc959-008e-4782-8f39-df709fbb4636+7:10374:x1869324914538496:12345-192.168.202.60@tcp:36:chown.0 Request processed in 6859us (12315us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1782727413.662995:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 19 00010000:00010000:1.0:1782727413.663075:0:3428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1200/0x14a47870ee88cd3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.663085:0:3428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1200/0x14a47870ee88cd3a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.663092:0:3428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1200/0x14a47870ee88cd3a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.663098:0:3428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c7a3e1200 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1782727413.663103:0:3428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1200/0x14a47870ee88cd3a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.663110:0:3428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1200/0x14a47870ee88cd3a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.663125:0:3428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff921c58b4cd00) 00010000:00010000:1.0:1782727413.663128:0:3428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782727413.663133:0:3428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1200/0x14a47870ee88cd3a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.663140:0:3428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1200/0x14a47870ee88cd3a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727413.691074:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1782727413.691305:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914538624 00000100:00100000:0.0:1782727413.691316:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914538624 00000100:00100000:0.0:1782727413.691415:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 20 00000100:00100000:0.0:1782727413.691426:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c45e43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d85bc959-008e-4782-8f39-df709fbb4636+6:10375:x1869324914538624:12345-192.168.202.60@tcp:101:touch.500 00010000:00010000:0.0:1782727413.691462:0:5948:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727413.691482:0:5948:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0a00/0x14a47870ee88cd41 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1752a87bbfbdf0e3 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782727413.696085:0:5948:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 4551us 00010000:00010000:3.0:1782727413.703120:0:5948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151c800/0x14a47870ee88cd48 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727413.703144:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151c800/0x14a47870ee88cd48 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727413.703157:0:5948:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151c800/0x14a47870ee88cd48 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727413.703171:0:5948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151ce00/0x14a47870ee88cd4f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727413.703178:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151ce00/0x14a47870ee88cd4f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727413.703184:0:5948:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151ce00/0x14a47870ee88cd4f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727413.703408:0:5948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151d800/0x14a47870ee88cd56 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727413.703427:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151d800/0x14a47870ee88cd56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727413.703436:0:5948:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151d800/0x14a47870ee88cd56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782727413.703472:0:5948:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1782727413.703483:0:5948:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782727413.703523:0:5948:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151d800/0x14a47870ee88cd56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727413.703536:0:5948:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151c800/0x14a47870ee88cd48 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727413.703543:0:5948:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151c800/0x14a47870ee88cd48 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727413.703551:0:5948:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151c800/0x14a47870ee88cd48 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727413.703568:0:5948:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c4151c800 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1782727413.703573:0:5948:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151c800/0x14a47870ee88cd48 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727413.703581:0:5948:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151c800/0x14a47870ee88cd48 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727413.703596:0:5948:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921c58b4c300) 00010000:00010000:3.0:1782727413.703599:0:5948:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782727413.703604:0:5948:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151c800/0x14a47870ee88cd48 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727413.703610:0:5948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151c800/0x14a47870ee88cd48 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727413.703621:0:5948:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151ce00/0x14a47870ee88cd4f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727413.703628:0:5948:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151ce00/0x14a47870ee88cd4f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727413.703651:0:5948:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151ce00/0x14a47870ee88cd4f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727413.703656:0:5948:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c4151ce00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1782727413.703659:0:5948:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151ce00/0x14a47870ee88cd4f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727413.703667:0:5948:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151ce00/0x14a47870ee88cd4f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727413.703674:0:5948:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff921c5fdb6700) 00010000:00010000:3.0:1782727413.703676:0:5948:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782727413.703679:0:5948:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151ce00/0x14a47870ee88cd4f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727413.703685:0:5948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151ce00/0x14a47870ee88cd4f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727413.703724:0:5948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0a00/0x14a47870ee88cd41 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf0e3 expref: 8 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727413.703752:0:5948:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151d800/0x14a47870ee88cd56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf0e3 expref: 7 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727413.703759:0:5948:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff921c5fdb6300) 00010000:00010000:3.0:1782727413.703762:0:5948:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1782727413.703765:0:5948:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c4151d800, rc 0) 00000100:00100000:3.0:1782727413.703852:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c45e43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d85bc959-008e-4782-8f39-df709fbb4636+7:10375:x1869324914538624:12345-192.168.202.60@tcp:101:touch.500 Request processed in 12426us (12785us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727413.703870:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 20 00000100:00100000:3.0:1782727413.707394:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1782727413.709544:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914538880 00000100:00100000:0.0:1782727413.709798:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914538880 00000100:00100000:0.0:1782727413.711406:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 21 00000100:00100000:0.0:1782727413.711433:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e13c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d85bc959-008e-4782-8f39-df709fbb4636+7:10375:x1869324914538880:12345-192.168.202.60@tcp:101:touch.500 00010000:00010000:0.0:1782727413.711455:0:5950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727413.711480:0:5950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1800/0x14a47870ee88cd5d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1752a87bbfbdf0ea expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.711591:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1000/0x14a47870ee88cd64 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.711607:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1000/0x14a47870ee88cd64 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.711621:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1000/0x14a47870ee88cd64 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.711675:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0e00/0x14a47870ee88cd6b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xad2fb6a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.711698:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0e00/0x14a47870ee88cd6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xad2fb6a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.711708:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0e00/0x14a47870ee88cd6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xad2fb6a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782727413.712174:0:5950:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:0.0:1782727413.712356:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1200/0x14a47870ee88cd72 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.712368:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1200/0x14a47870ee88cd72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.712378:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1200/0x14a47870ee88cd72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.712412:0:5950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1000/0x14a47870ee88cd64 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.712420:0:5950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1000/0x14a47870ee88cd64 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.712427:0:5950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1000/0x14a47870ee88cd64 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.712435:0:5950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c7a3e1000 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:0.0:1782727413.712440:0:5950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1000/0x14a47870ee88cd64 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.712448:0:5950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1000/0x14a47870ee88cd64 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.712462:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff921c5fdb6300) 00010000:00010000:0.0:1782727413.712466:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782727413.712471:0:5950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1000/0x14a47870ee88cd64 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.712488:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1000/0x14a47870ee88cd64 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782727413.712505:0:5950:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cd13f00b reply state 000000007f5c21c2 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0e00/0x14a47870ee88cd6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xad2fb6a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727413.712515:0:5950:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1782727413.712550:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1800/0x14a47870ee88cd5d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf0ea expref: 10 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.712570:0:5950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1200/0x14a47870ee88cd72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf0ea expref: 9 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.712578:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff921c58b4cc00) 00010000:00010000:0.0:1782727413.712580:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782727413.712584:0:5950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c7a3e1200, rc 0) 00000100:00100000:0.0:1782727413.712663:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e13c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d85bc959-008e-4782-8f39-df709fbb4636+10:10375:x1869324914538880:12345-192.168.202.60@tcp:101:touch.500 Request processed in 1243us (5278us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1782727413.712674:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 21 00010000:00010000:1.0:1782727413.721344:0:3428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0e00/0x14a47870ee88cd6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xad2fb6a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.721362:0:3428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0e00/0x14a47870ee88cd6b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xad2fb6a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.721370:0:3428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0e00/0x14a47870ee88cd6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xad2fb6a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.721377:0:3428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c7a3e0e00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1782727413.721382:0:3428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0e00/0x14a47870ee88cd6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xad2fb6a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.721390:0:3428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0e00/0x14a47870ee88cd6b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xad2fb6a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.721407:0:3428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xad2fb6a4 (ffff921c58b4c900) 00010000:00010000:1.0:1782727413.721410:0:3428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782727413.721414:0:3428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0e00/0x14a47870ee88cd6b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xad2fb6a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.721420:0:3428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0e00/0x14a47870ee88cd6b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xad2fb6a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727413.728251:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1782727413.739698:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914539136 00000100:00100000:0.0:1782727413.739713:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914539136 00000100:00100000:1.0:1782727413.741301:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 22 00000100:00100000:1.0:1782727413.741326:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e13ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d85bc959-008e-4782-8f39-df709fbb4636+9:10375:x1869324914539136:12345-192.168.202.60@tcp:36:touch.500 00010000:00010000:1.0:1782727413.741385:0:5948:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782727413.741410:0:5948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1200/0x14a47870ee88cd72 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf0ea expref: 9 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.741445:0:5948:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff921c58b4cc00) 00010000:00010000:1.0:1782727413.741456:0:5948:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782727413.741507:0:5948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669000/0x14a47870ee88cd80 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.741519:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669000/0x14a47870ee88cd80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.741529:0:5948:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669000/0x14a47870ee88cd80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782727413.741629:0:5948:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f764ac28 reply state 00000000310d6bfd transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669000/0x14a47870ee88cd80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727413.741639:0:5948:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782727413.741737:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e13ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d85bc959-008e-4782-8f39-df709fbb4636+10:10375:x1869324914539136:12345-192.168.202.60@tcp:36:touch.500 Request processed in 423us (13495us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1782727413.748145:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00010000:00010000:3.0:1782727413.748254:0:3429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669000/0x14a47870ee88cd80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727413.748266:0:3429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669000/0x14a47870ee88cd80 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727413.748273:0:3429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669000/0x14a47870ee88cd80 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727413.748279:0:3429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c76669000 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1782727413.748284:0:3429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669000/0x14a47870ee88cd80 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727413.748292:0:3429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669000/0x14a47870ee88cd80 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727413.748309:0:3429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff921c5fda7300) 00010000:00010000:3.0:1782727413.748312:0:3429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782727413.748316:0:3429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669000/0x14a47870ee88cd80 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727413.748322:0:3429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669000/0x14a47870ee88cd80 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727413.748446:0:5950:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1782727413.748458:0:5950:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1782727413.748651:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914539264 00000100:00100000:0.0:1782727413.748660:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914539264 00000100:00100000:3.0:1782727413.750006:0:12227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 23 00000100:00100000:3.0:1782727413.750023:0:12227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e030700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d85bc959-008e-4782-8f39-df709fbb4636+10:10375:x1869324914539264:12345-192.168.202.60@tcp:101:touch.500 00010000:00010000:3.0:1782727413.750058:0:12227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727413.750147:0:12227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151ce00/0x14a47870ee88cd87 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1752a87bbfbdf0f1 expref: -99 pid: 12227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727413.750217:0:12227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151ce00/0x14a47870ee88cd87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf0f1 expref: 11 pid: 12227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727413.750314:0:12227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151ce00/0x14a47870ee88cd87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf0f1 expref: 11 pid: 12227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727413.750335:0:12227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff921c5fdb6700) 00010000:00010000:3.0:1782727413.750338:0:12227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782727413.750341:0:12227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c4151ce00, rc 0) 00000100:00100000:3.0:1782727413.750462:0:12227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e030700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d85bc959-008e-4782-8f39-df709fbb4636+11:10375:x1869324914539264:12345-192.168.202.60@tcp:101:touch.500 Request processed in 444us (2397us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727413.750470:0:12227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 23 00000100:00100000:1.0:1782727413.750861:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 22 00000100:00100000:0.0:1782727413.754421:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1782727413.756641:0:6951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914539392 00000100:00100000:1.0:1782727413.756655:0:6951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914539392 00000100:00100000:1.0:1782727413.756711:0:6951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 12 00000100:00100000:1.0:1782727413.756720:0:6951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2354:x1869324914539392:12345-192.168.202.60@tcp:8:touch.500 00010000:00080000:1.0:1782727413.756752:0:6951:0:(ldlm_lib.c:1434:target_handle_connect()) lustre-OST0001: connection from d85bc959-008e-4782-8f39-df709fbb4636@192.168.202.60@tcp t0 exp 0000000000000000 cur 308 last 0 00000020:00000080:1.0:1782727413.756778:0:6951:0:(genops.c:1406:class_connect()) connect: client d85bc959-008e-4782-8f39-df709fbb4636, cookie 0x14a47870ee88cd8e 00002000:00100000:1.0:1782727413.756790:0:6951:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d85bc959-008e-4782-8f39-df709fbb4636/ffff921c7dfe3000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1782727413.756800:0:6951:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1782727413.756902:0:6951:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1782727413.756937:0:6951:0:(import.c:65:import_set_state_nolock()) ffff921c7dfe1000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782727413.757012:0:6951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d85bc959-008e-4782-8f39-df709fbb4636+6:2354:x1869324914539392:12345-192.168.202.60@tcp:8:touch.500 Request processed in 292us (2602us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727413.757020:0:6951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 12 00000100:00100000:0.0:1782727413.762493:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1782727413.762542:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1782727413.762742:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914539648 00000100:00100000:2.0:1782727413.762753:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914539648 00000100:00100000:1.0:1782727413.762758:0:6950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914539520 00000100:00100000:1.0:1782727413.762765:0:6950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914539520 00000100:00100000:2.0:1782727413.762823:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 240 00000100:00100000:1.0:1782727413.762824:0:6950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 13 00000100:00100000:2.0:1782727413.762842:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6dd3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecaf1fda-ff42-4054-9f39-8e142296107b+10:2356:x1869324914539648:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1782727413.762842:0:6950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d85bc959-008e-4782-8f39-df709fbb4636+6:0:x1869324914539520:12345-192.168.202.60@tcp:2:touch.500 00000100:00100000:2.0:1782727413.762963:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6dd3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecaf1fda-ff42-4054-9f39-8e142296107b+10:2356:x1869324914539648:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 129us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727413.762973:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 240 00000100:00080000:0.0:1782727413.763496:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1782727413.767028:0:8019:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:3.0:1782727413.767042:0:8019:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d85bc959-008e-4782-8f39-df709fbb4636 00000100:00100000:1.0:1782727413.767380:0:6950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d85bc959-008e-4782-8f39-df709fbb4636+5:0:x1869324914539520:12345-192.168.202.60@tcp:2:touch.500 Request processed in 4539us (4888us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1782727413.767391:0:6950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 13 00000100:00100000:1.0:1782727413.770374:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1782727413.770549:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914539904 00000100:00100000:0.0:1782727413.770561:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914539904 00000100:00100000:0.0:1782727413.770626:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 2 00000100:00100000:0.0:1782727413.770638:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c45e41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d85bc959-008e-4782-8f39-df709fbb4636+10:10375:x1869324914539904:12345-192.168.202.60@tcp:35:touch.500 00000100:00100000:0.0:1782727413.771216:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c45e41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d85bc959-008e-4782-8f39-df709fbb4636+11:10375:x1869324914539904:12345-192.168.202.60@tcp:35:touch.500 Request processed in 578us (852us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1782727413.771226:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 2 00000100:00100000:3.0:1782727413.780754:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1782727413.780862:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914540032 00000100:00100000:0.0:1782727413.781188:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914540032 00000100:00100000:2.0:1782727413.782496:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 24 00000100:00100000:2.0:1782727413.782509:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e030000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d85bc959-008e-4782-8f39-df709fbb4636+11:10376:x1869324914540032:12345-192.168.202.60@tcp:101:rm.0 00010000:00010000:2.0:1782727413.782532:0:5950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727413.782623:0:5950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d4800/0x14a47870ee88cd95 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1752a87bbfbdf0f8 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727413.782748:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d5600/0x14a47870ee88cd9c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727413.782762:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d5600/0x14a47870ee88cd9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727413.782773:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d5600/0x14a47870ee88cd9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782727413.782818:0:5950:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1782727413.782821:0:5950:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782727413.782853:0:5950:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d5600/0x14a47870ee88cd9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727413.782877:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d4800/0x14a47870ee88cd95 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf0f8 expref: 13 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727413.787742:0:5950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d5600/0x14a47870ee88cd9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf0f8 expref: 12 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727413.787786:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff921c5fdb6300) 00010000:00010000:2.0:1782727413.787789:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782727413.787793:0:5950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c429d5600, rc 0) 00000100:00100000:2.0:1782727413.787876:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e030000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d85bc959-008e-4782-8f39-df709fbb4636+12:10376:x1869324914540032:12345-192.168.202.60@tcp:101:rm.0 Request processed in 5365us (7126us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727413.787900:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 24 00000100:00100000:2.0:1782727413.792780:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1782727413.792865:0:12227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914540288 00000100:00100000:3.0:1782727413.792873:0:12227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914540288 00000100:00100000:3.0:1782727413.792957:0:12227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 25 00000100:00100000:3.0:1782727413.792966:0:12227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d85bc959-008e-4782-8f39-df709fbb4636+12:10376:x1869324914540288:12345-192.168.202.60@tcp:101:rm.0 00010000:00010000:3.0:1782727413.792985:0:12227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727413.793004:0:12227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151c800/0x14a47870ee88cda3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1752a87bbfbdf0ff expref: -99 pid: 12227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782727413.793109:0:12227:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1782727413.793494:0:12227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151c800/0x14a47870ee88cda3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf0ff expref: 14 pid: 12227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727413.793508:0:12227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921c58b4c300) 00010000:00010000:3.0:1782727413.793510:0:12227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782727413.793516:0:12227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151c800/0x14a47870ee88cda3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf0ff expref: 14 pid: 12227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727413.793529:0:12227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c4151c800, rc 0) 00000100:00100000:3.0:1782727413.793716:0:12227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d85bc959-008e-4782-8f39-df709fbb4636+13:10376:x1869324914540288:12345-192.168.202.60@tcp:101:rm.0 Request processed in 750us (944us total) trans 4294967303 rc 301/301 00000100:00100000:3.0:1782727413.793724:0:12227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 25 00000100:00100000:3.0:1782727413.808724:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1782727413.808872:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914540416 00000100:00100000:2.0:1782727413.808918:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914540416 00000100:00100000:2.0:1782727413.808972:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 3 00000100:00100000:2.0:1782727413.808981:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e033100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d85bc959-008e-4782-8f39-df709fbb4636+13:10376:x1869324914540416:12345-192.168.202.60@tcp:37:rm.0 00000100:00100000:1.0:1782727413.817495:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e033100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d85bc959-008e-4782-8f39-df709fbb4636+13:10376:x1869324914540416:12345-192.168.202.60@tcp:37:rm.0 Request processed in 8504us (8770us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727413.817508:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 3 00000100:00100000:3.0:1782727413.825410:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1782727413.826699:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914540672 00000100:00100000:0.0:1782727413.826710:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914540672 00000100:00100000:0.0:1782727413.826777:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 4 00000100:00100000:0.0:1782727413.826787:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c66fd1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d85bc959-008e-4782-8f39-df709fbb4636+13:10376:x1869324914540672:12345-192.168.202.60@tcp:35:rm.0 00000100:00100000:0.0:1782727413.827068:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c66fd1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d85bc959-008e-4782-8f39-df709fbb4636+14:10376:x1869324914540672:12345-192.168.202.60@tcp:35:rm.0 Request processed in 281us (1665us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1782727413.827076:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 4 00000100:00100000:3.0:1782727413.841374:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1782727413.842100:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914540928 00000100:00100000:0.0:1782727413.842110:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914540928 00000100:00100000:0.0:1782727413.842181:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 26 00000100:00100000:0.0:1782727413.842190:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e033100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d85bc959-008e-4782-8f39-df709fbb4636+14:10376:x1869324914540928:12345-192.168.202.60@tcp:101:rm.0 00010000:00010000:0.0:1782727413.842222:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727413.842241:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1a00/0x14a47870ee88cdb1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1752a87bbfbdf106 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.842343:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1200/0x14a47870ee88cdb8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.842358:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1200/0x14a47870ee88cdb8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.842384:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1200/0x14a47870ee88cdb8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782727413.842396:0:5949:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1782727413.842520:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1a00/0x14a47870ee88cdb1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf106 expref: 17 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.842539:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1200/0x14a47870ee88cdb8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf106 expref: 16 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.842547:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff921c5fdb6300) 00010000:00010000:0.0:1782727413.842550:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1782727413.842565:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c7a3e1200, rc 0) 00000100:00100000:0.0:1782727413.842623:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e033100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d85bc959-008e-4782-8f39-df709fbb4636+16:10376:x1869324914540928:12345-192.168.202.60@tcp:101:rm.0 Request processed in 434us (1259us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1782727413.842630:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 26 00000100:00100000:2.0:1782727413.853170:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1782727413.853261:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914541056 00000100:00100000:1.0:1782727413.853272:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914541056 00000100:00100000:1.0:1782727413.853331:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 27 00000100:00100000:1.0:1782727413.853340:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d85bc959-008e-4782-8f39-df709fbb4636+16:10376:x1869324914541056:12345-192.168.202.60@tcp:41:rm.0 00000004:00000024:1.0:1782727413.853407:0:5948:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 7847337984 avail 7384293376 00000100:00100000:1.0:1782727413.853489:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d85bc959-008e-4782-8f39-df709fbb4636+16:10376:x1869324914541056:12345-192.168.202.60@tcp:41:rm.0 Request processed in 149us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727413.853497:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 27 00000100:00100000:3.0:1782727413.861644:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1782727413.864420:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914541184 00000100:00100000:0.0:1782727413.864441:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914541184 00000100:00100000:0.0:1782727413.864538:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 28 00000100:00100000:0.0:1782727413.864551:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d85bc959-008e-4782-8f39-df709fbb4636+16:10376:x1869324914541184:12345-192.168.202.60@tcp:101:rm.0 00010000:00010000:0.0:1782727413.864577:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727413.864606:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1a00/0x14a47870ee88cdc6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1752a87bbfbdf10d expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.864701:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1000/0x14a47870ee88cdcd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.864740:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1000/0x14a47870ee88cdcd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.864755:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1000/0x14a47870ee88cdcd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.864774:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1800/0x14a47870ee88cdd4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xad2fb6a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.864781:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1800/0x14a47870ee88cdd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xad2fb6a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.864788:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1800/0x14a47870ee88cdd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xad2fb6a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.864932:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0e00/0x14a47870ee88cddb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.864941:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0e00/0x14a47870ee88cddb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.864948:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0e00/0x14a47870ee88cddb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782727413.865355:0:5949:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:0.0:1782727413.865360:0:5949:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782727413.865383:0:5949:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0e00/0x14a47870ee88cddb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.865398:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0e00/0x14a47870ee88cddb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.865419:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1000/0x14a47870ee88cdcd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.865425:0:5949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1000/0x14a47870ee88cdcd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.865432:0:5949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1000/0x14a47870ee88cdcd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.865439:0:5949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c7a3e1000 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:0.0:1782727413.865444:0:5949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1000/0x14a47870ee88cdcd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.865452:0:5949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1000/0x14a47870ee88cdcd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.865467:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff921c5fdb6300) 00010000:00010000:0.0:1782727413.865470:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782727413.865475:0:5949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1000/0x14a47870ee88cdcd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.865482:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1000/0x14a47870ee88cdcd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.865498:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1800/0x14a47870ee88cdd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xad2fb6a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.865503:0:5949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1800/0x14a47870ee88cdd4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xad2fb6a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.865509:0:5949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1800/0x14a47870ee88cdd4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xad2fb6a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.865521:0:5949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c7a3e1800 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:0.0:1782727413.865523:0:5949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1800/0x14a47870ee88cdd4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xad2fb6a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.865529:0:5949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1800/0x14a47870ee88cdd4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xad2fb6a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.865537:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xad2fb6a4 (ffff921c58b4c800) 00010000:00010000:0.0:1782727413.865539:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782727413.865541:0:5949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1800/0x14a47870ee88cdd4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xad2fb6a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.865546:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1800/0x14a47870ee88cdd4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xad2fb6a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.865582:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1a00/0x14a47870ee88cdc6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf10d expref: 18 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.865597:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0e00/0x14a47870ee88cddb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf10d expref: 17 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.865604:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff921c5fdb6700) 00010000:00010000:0.0:1782727413.865606:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782727413.865608:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c7a3e0e00, rc 0) 00000100:00100000:0.0:1782727413.865712:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d85bc959-008e-4782-8f39-df709fbb4636+17:10376:x1869324914541184:12345-192.168.202.60@tcp:101:rm.0 Request processed in 1163us (4082us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727413.865721:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 28 00000100:00100000:2.0:1782727413.871459:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1782727413.873827:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914541440 00000100:00100000:1.0:1782727413.873843:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914541440 00000100:00100000:1.0:1782727413.873958:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 29 00000100:00100000:1.0:1782727413.873969:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d85bc959-008e-4782-8f39-df709fbb4636+17:10376:x1869324914541440:12345-192.168.202.60@tcp:36:rm.0 00010000:00010000:1.0:1782727413.874027:0:5948:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1782727413.874053:0:5948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0e00/0x14a47870ee88cddb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf10d expref: 17 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.874076:0:5948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151ce00/0x14a47870ee88cd87 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf0f1 expref: 16 pid: 12227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.874088:0:5948:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff921c5fdb6700) 00010000:00010000:1.0:1782727413.874105:0:5948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d5600/0x14a47870ee88cd9c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf0f8 expref: 15 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.874131:0:5948:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff921c5fdb6300) 00010000:00010000:1.0:1782727413.874135:0:5948:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782727413.874176:0:5948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668600/0x14a47870ee88cde2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.874189:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668600/0x14a47870ee88cde2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.874210:0:5948:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668600/0x14a47870ee88cde2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.874235:0:5948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669a00/0x14a47870ee88cde9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xad2fb6a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.874243:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669a00/0x14a47870ee88cde9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xad2fb6a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.874261:0:5948:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669a00/0x14a47870ee88cde9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xad2fb6a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.874379:0:5948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668200/0x14a47870ee88cdf0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.874388:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668200/0x14a47870ee88cdf0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.874396:0:5948:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668200/0x14a47870ee88cdf0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782727413.876283:0:5948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1782727413.876294:0:5948:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 308634409714ns, next at 309634407891ns, rc = 0 00010000:00010000:1.0:1782727413.876350:0:5948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668800/0x14a47870ee88cdf7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.876366:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668800/0x14a47870ee88cdf7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.876375:0:5948:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668800/0x14a47870ee88cdf7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.876384:0:5948:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668800/0x14a47870ee88cdf7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.876391:0:5948:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668800/0x14a47870ee88cdf7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.876398:0:5948:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668800/0x14a47870ee88cdf7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.877593:0:5948:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782727413.877619:0:5948:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668200/0x14a47870ee88cdf0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.877627:0:5948:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668200/0x14a47870ee88cdf0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.877634:0:5948:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668200/0x14a47870ee88cdf0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.877771:0:5948:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c76668200 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1782727413.877776:0:5948:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668200/0x14a47870ee88cdf0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.877785:0:5948:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668200/0x14a47870ee88cdf0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.877798:0:5948:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff921c5fda7700) 00010000:00010000:1.0:1782727413.877801:0:5948:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1782727413.877805:0:5948:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668200/0x14a47870ee88cdf0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.877813:0:5948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668200/0x14a47870ee88cdf0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.877834:0:5948:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668600/0x14a47870ee88cde2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.877841:0:5948:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668600/0x14a47870ee88cde2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.877847:0:5948:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668600/0x14a47870ee88cde2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.877858:0:5948:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c76668600 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1782727413.877862:0:5948:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668600/0x14a47870ee88cde2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.877869:0:5948:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668600/0x14a47870ee88cde2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.877877:0:5948:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff921c5fdb6300) 00010000:00010000:1.0:1782727413.877880:0:5948:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782727413.877988:0:8027:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782727413.877995:0:8027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668800/0x14a47870ee88cdf7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727413.878004:0:8027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c76668800 already unused, calling callback (ffffffffc0c98cf0) 00010000:00010000:3.0:1782727413.878007:0:8027:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668800/0x14a47870ee88cdf7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727413.878014:0:8027:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668800/0x14a47870ee88cdf7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727413.878036:0:8027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff921c5fda7700) 00010000:00010000:3.0:1782727413.878039:0:8027:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782727413.878043:0:8027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668800/0x14a47870ee88cdf7 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727413.878049:0:8027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668800/0x14a47870ee88cdf7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.878055:0:5948:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668600/0x14a47870ee88cde2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.878065:0:5948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668600/0x14a47870ee88cde2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782727413.878079:0:5948:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000935019af reply state 000000001f2a7461 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669a00/0x14a47870ee88cde9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xad2fb6a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727413.878081:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727413.878086:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727413.878089:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727413.878092:0:5948:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782727413.880729:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d85bc959-008e-4782-8f39-df709fbb4636+16:10376:x1869324914541440:12345-192.168.202.60@tcp:36:rm.0 Request processed in 6750us (9268us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1782727413.880743:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 29 00010000:00010000:1.0:1782727413.884780:0:3428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669a00/0x14a47870ee88cde9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xad2fb6a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.884798:0:3428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669a00/0x14a47870ee88cde9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xad2fb6a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.884805:0:3428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669a00/0x14a47870ee88cde9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xad2fb6a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.884830:0:3428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c76669a00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1782727413.884835:0:3428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669a00/0x14a47870ee88cde9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xad2fb6a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.884842:0:3428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669a00/0x14a47870ee88cde9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xad2fb6a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.884858:0:3428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xad2fb6a4 (ffff921c5fda7000) 00010000:00010000:1.0:1782727413.884862:0:3428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782727413.884866:0:3428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669a00/0x14a47870ee88cde9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xad2fb6a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727413.884874:0:3428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669a00/0x14a47870ee88cde9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xad2fb6a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727413.888754:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1782727413.888995:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914541696 00000100:00100000:0.0:1782727413.889015:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914541696 00000100:00100000:0.0:1782727413.889063:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 5 00000100:00100000:0.0:1782727413.889081:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d85bc959-008e-4782-8f39-df709fbb4636+15:10376:x1869324914541696:12345-192.168.202.60@tcp:35:rm.0 00000100:00100000:0.0:1782727413.889288:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d85bc959-008e-4782-8f39-df709fbb4636+16:10376:x1869324914541696:12345-192.168.202.60@tcp:35:rm.0 Request processed in 207us (541us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1782727413.889295:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 5 00000100:00100000:3.0:1782727413.892807:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1782727413.892998:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914541952 00000100:00100000:0.0:1782727413.893008:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914541952 00000100:00100000:0.0:1782727413.893067:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 30 00000100:00100000:0.0:1782727413.893087:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d85bc959-008e-4782-8f39-df709fbb4636+16:10376:x1869324914541952:12345-192.168.202.60@tcp:36:rm.0 00010000:00010000:0.0:1782727413.893143:0:5949:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1782727413.893168:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1200/0x14a47870ee88cdb8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf106 expref: 16 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.893190:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151d800/0x14a47870ee88cd56 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf0e3 expref: 15 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.893230:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff921c5fdb6300) 00010000:00010000:0.0:1782727413.893280:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0c00/0x14a47870ee88cd17 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf0d5 expref: 14 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.893290:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921c58b4c300) 00010000:00010000:0.0:1782727413.893298:0:5949:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782727413.893320:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1a00/0x14a47870ee88cdfe lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.893332:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1a00/0x14a47870ee88cdfe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.893355:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1a00/0x14a47870ee88cdfe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.893368:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1800/0x14a47870ee88ce05 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.893375:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1800/0x14a47870ee88ce05 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.893382:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1800/0x14a47870ee88ce05 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.893585:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1000/0x14a47870ee88ce0c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.893595:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1000/0x14a47870ee88ce0c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.893602:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1000/0x14a47870ee88ce0c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782727413.893815:0:5949:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1782727413.893829:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1000/0x14a47870ee88ce0c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.893836:0:5949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1000/0x14a47870ee88ce0c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.893842:0:5949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1000/0x14a47870ee88ce0c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.893847:0:5949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c7a3e1000 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:0.0:1782727413.893859:0:5949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1000/0x14a47870ee88ce0c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.893866:0:5949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1000/0x14a47870ee88ce0c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.894256:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff921c58b4cc00) 00010000:00010000:0.0:1782727413.894260:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782727413.894265:0:5949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1000/0x14a47870ee88ce0c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.894271:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1000/0x14a47870ee88ce0c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.894291:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1a00/0x14a47870ee88cdfe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.894297:0:5949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1a00/0x14a47870ee88cdfe lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.894302:0:5949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1a00/0x14a47870ee88cdfe lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.894307:0:5949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c7a3e1a00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:0.0:1782727413.894309:0:5949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1a00/0x14a47870ee88cdfe lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.894315:0:5949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1a00/0x14a47870ee88cdfe lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.894321:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921c58b4c800) 00010000:00010000:0.0:1782727413.894323:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782727413.894336:0:5949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1a00/0x14a47870ee88cdfe lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727413.894341:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1a00/0x14a47870ee88cdfe lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782727413.894353:0:5949:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f2640a10 reply state 00000000f97fe3e6 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1800/0x14a47870ee88ce05 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727413.894360:0:5949:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782727413.895595:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d85bc959-008e-4782-8f39-df709fbb4636+15:10376:x1869324914541952:12345-192.168.202.60@tcp:36:rm.0 Request processed in 2502us (2789us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1782727413.895606:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 30 00010000:00010000:3.0:1782727413.906833:0:3429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1800/0x14a47870ee88ce05 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727413.906853:0:3429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1800/0x14a47870ee88ce05 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727413.906861:0:3429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1800/0x14a47870ee88ce05 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727413.906868:0:3429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c7a3e1800 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1782727413.906920:0:3429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1800/0x14a47870ee88ce05 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727413.906929:0:3429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1800/0x14a47870ee88ce05 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727413.906946:0:3429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff921c58b4cb00) 00010000:00010000:3.0:1782727413.906949:0:3429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782727413.906968:0:3429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1800/0x14a47870ee88ce05 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727413.906975:0:3429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1800/0x14a47870ee88ce05 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727414.265334:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727415.289180:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727416.317520:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727417.338210:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727418.364925:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1782727418.553352:0:8459:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 313311466457ns, next at 314311464268ns, rc = 0 00000100:00100000:3.0:1782727418.553655:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e0e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c71e9f0f-6441-4b9b-bc96-153ab9250801:3444:1869324939745024:0@lo:400:kworker.0 00000100:00100000:3.0:1782727418.553734:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727418.553796:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e1ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3444:1869324939745536:0@lo:400:kworker.0 00000100:00100000:3.0:1782727418.553823:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727418.553850:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1782727418.553855:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7df20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869324939745152:0@lo:400:kworker.0 00000100:00100000:3.0:1782727418.553876:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727418.553918:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e1efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869324939745664:0@lo:400:kworker.0 00000100:00100000:3.0:1782727418.553941:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727418.553970:0:12227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939745536 00000100:00100000:3.0:1782727418.553977:0:12227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939745536 00000100:00100000:3.0:1782727418.554023:0:12227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939745152 00000100:00100000:3.0:1782727418.554026:0:12227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939745152 00000100:00100000:3.0:1782727418.554043:0:12227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1782727418.554052:0:12227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1869324939745536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727418.554102:0:12227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1869324939745536:12345-0@lo:400:kworker.0 Request processed in 50us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727418.554109:0:12227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1782727418.554146:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e1ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3444:1869324939745536:0@lo:400:kworker.0 00000100:00100000:3.0:1782727418.554180:0:12227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1782727418.554194:0:12227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869324939745152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727418.554228:0:12227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869324939745152:12345-0@lo:400:kworker.0 Request processed in 35us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727418.554234:0:12227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1782727418.554256:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7df20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869324939745152:0@lo:400:kworker.0 00000100:00100000:1.0:1782727418.554474:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7d6e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3442:1869324939745280:0@lo:400:kworker.0 00000100:00100000:1.0:1782727418.554509:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727418.554533:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1782727418.554541:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e0fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869324939744896:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782727418.554544:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939745024 00000100:00100000:0.0:1782727418.554549:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939745024 00000100:00100000:1.0:1782727418.554567:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727418.554588:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e1ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869324939745408:0@lo:400:kworker.0 00000100:00100000:0.0:1782727418.554591:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1782727418.554603:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6dd3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:3444:x1869324939745024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727418.554615:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727418.554651:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6dd3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:3444:x1869324939745024:12345-0@lo:400:kworker.0 Request processed in 49us (915us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727418.554657:0:6951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939745664 00000100:00100000:0.0:1782727418.554660:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1782727418.554663:0:6951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939745664 00000100:00100000:1.0:1782727418.554694:0:6951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939745408 00000100:00100000:1.0:1782727418.554696:0:6951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939745408 00000100:00080000:0.0:1782727418.554705:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782727418.554711:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782727418.554713:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782727418.554730:0:6951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1782727418.554730:0:6953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939744896 00000100:00100000:0.0:1782727418.554736:0:6953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939744896 00000100:00100000:1.0:1782727418.554741:0:6951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324939745664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727418.554775:0:6951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3444:x1869324939745664:12345-0@lo:400:kworker.0 Request processed in 37us (833us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727418.554782:0:6951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1782727418.554786:0:6953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1782727418.554795:0:6953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c45e41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1869324939744896:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782727418.554802:0:6951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1782727418.554811:0:6951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c45e45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3442:x1869324939745408:12345-0@lo:400:kworker.0 00002000:00000024:0.0:1782727418.554817:0:6953:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1782727418.554845:0:6951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c45e45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3442:x1869324939745408:12345-0@lo:400:kworker.0 Request processed in 36us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727418.554852:0:6951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1782727418.554863:0:6953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c45e41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1869324939744896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727418.554870:0:6953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:1.0:1782727418.554935:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c7e0fb480 x1869324939744896/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727434 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727418.554942:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939745280 00000100:00100000:0.0:1782727418.554947:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939745280 00000100:00100000:1.0:1782727418.554956:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e0fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869324939744896:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1782727418.554964:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1782727418.554971:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c7e1ee680 x1869324939745408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727418.554980:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e1ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869324939745408:0@lo:400:kworker.0 00000100:00100000:0.0:1782727418.554988:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1782727418.554998:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c45e41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1869324939745280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727418.555044:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c45e41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1869324939745280:12345-0@lo:400:kworker.0 Request processed in 49us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727418.555051:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00010000:00080000:3.0:1782727418.555489:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c7e1efb80 x1869324939745664/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727418.555499:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e1efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869324939745664:0@lo:400:kworker.0 00000100:00100000:3.0:1782727418.555508:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e0e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c71e9f0f-6441-4b9b-bc96-153ab9250801:3444:1869324939745024:0@lo:400:kworker.0 00000100:00100000:1.0:1782727418.555581:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e0fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869324939745792:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782727418.555611:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727418.555649:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7d6e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3442:1869324939745280:0@lo:400:kworker.0 00000100:00100000:0.0:1782727418.557291:0:6952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939745792 00000100:00100000:0.0:1782727418.557303:0:6952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939745792 00000100:00100000:0.0:1782727418.557422:0:6952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1782727418.557431:0:6952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6e382d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1869324939745792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782727418.557474:0:6952:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1782727418.557545:0:6952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6e382d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1869324939745792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (1931us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727418.557552:0:6952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:1.0:1782727418.557636:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c7e0fa680 x1869324939745792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727434 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727418.557654:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e0fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869324939745792:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782727418.883625:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1782727418.883675:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1782727418.883716:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1782727418.883781:0:6951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914542336 00000100:00100000:2.0:1782727418.883791:0:6951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914542336 00000100:00100000:2.0:1782727418.883876:0:6951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 41 00000100:00100000:2.0:1782727418.883928:0:6951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d85bc959-008e-4782-8f39-df709fbb4636+5:2357:x1869324914542336:12345-192.168.202.60@tcp:400:kworker.0 00000100:00080000:3.0:1782727418.884005:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782727418.884013:0:6951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d85bc959-008e-4782-8f39-df709fbb4636+5:2357:x1869324914542336:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 90us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727418.884023:0:6951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 41 00000100:00100000:1.0:1782727418.886268:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914542080 00000100:00100000:1.0:1782727418.886296:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914542080 00000100:00100000:1.0:1782727418.886368:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 242 00000100:00100000:1.0:1782727418.886379:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5d073c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecaf1fda-ff42-4054-9f39-8e142296107b+10:2357:x1869324914542080:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1782727418.886459:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5d073c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecaf1fda-ff42-4054-9f39-8e142296107b+10:2357:x1869324914542080:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 81us (2843us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727418.886466:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 242 00000100:00100000:1.0:1782727418.886513:0:12227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914542208 00000100:00100000:1.0:1782727418.886517:0:12227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914542208 00000100:00100000:1.0:1782727418.886568:0:12227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 109 00000100:00100000:1.0:1782727418.886575:0:12227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d85bc959-008e-4782-8f39-df709fbb4636+14:2357:x1869324914542208:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1782727418.886609:0:12227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d85bc959-008e-4782-8f39-df709fbb4636+14:2357:x1869324914542208:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 34us (2892us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727418.886615:0:12227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 109 00000100:00080000:3.0:1782727418.888024:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:2.0:1782727419.071974:0:5929:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:2.0:1782727419.071993:0:5929:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:2.0:1782727419.072006:0:5929:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:2.0:1782727419.072343:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e1ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869324939745920:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782727419.072418:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727419.073321:0:6950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939745920 00000100:00100000:3.0:1782727419.073333:0:6950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939745920 00000100:00100000:3.0:1782727419.073386:0:6950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1782727419.073397:0:6950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c8068d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3443:x1869324939745920:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1782727419.073426:0:6950:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:3.0:1782727419.073462:0:6950:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a4242f4, atime: 0x6a4242f4, ctime: 0x6a4242f4, blocks: 0x0 00010000:00010000:3.0:1782727419.073470:0:6950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000073d3da6/0x14a47870ee88ce13 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727419.073486:0:6950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=313s v=(0 0) 00010000:00010000:3.0:1782727419.073490:0:6950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782727419.073511:0:6950:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000073d3da6/0x14a47870ee88ce13 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727419.073526:0:6950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000073d3da6/0x14a47870ee88ce13 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727419.073537:0:6950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000073d3da6/0x14a47870ee88ce13 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727419.073545:0:6950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000073d3da6/0x14a47870ee88ce13 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727419.073562:0:6950:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782727419.073962:0:8027:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782727419.073970:0:8027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000073d3da6/0x14a47870ee88ce13 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727419.073979:0:8027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c4151c800 already unused, calling callback (ffffffffc0c98cf0) 00010000:00010000:0.0:1782727419.073983:0:8027:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000073d3da6/0x14a47870ee88ce13 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727419.073992:0:8027:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000073d3da6/0x14a47870ee88ce13 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727419.074011:0:8027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000073d3da6/0x14a47870ee88ce13 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727419.074038:0:8027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000073d3da6/0x14a47870ee88ce13 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727419.074067:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727419.074070:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727419.074072:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727419.075531:0:6950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c8068d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3443:x1869324939745920:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2129us (3106us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1782727419.075545:0:6950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:2.0:1782727419.076191:0:3443:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff921c7e1ee300/2, rc 0, transno 4294967300 00000100:00100000:2.0:1782727419.076201:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e1ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869324939745920:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1782727419.386123:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727420.416137:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727421.433253:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727422.457823:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727423.483347:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782727423.599264:0:12265:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 63b: async write errors should be returned to fsync ============================================================= 06:03:40 (1782727420) 00000100:00100000:1.0:1782727423.675552:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c6e383100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869324939746048:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782727423.675624:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727423.675850:0:6953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939746048 00000100:00100000:2.0:1782727423.675857:0:6953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939746048 00000100:00100000:2.0:1782727423.675952:0:6953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1782727423.675962:0:6953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6e381180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324939746048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782727423.675990:0:6953:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1782727423.676043:0:6953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6e381180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324939746048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727423.676049:0:6953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:2.0:1782727423.676069:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782727423.676365:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e0d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869324939746176:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782727423.676395:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1782727423.678991:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921c6e383100 x1869324939746048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727439 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727423.679028:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c6e383100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869324939746048:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782727423.679067:0:6953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939746176 00000100:00100000:3.0:1782727423.679073:0:6953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939746176 00000100:00100000:3.0:1782727423.679132:0:6953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1782727423.679142:0:6953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6e380a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3445:x1869324939746176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782727423.679172:0:6953:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1782727423.679252:0:6953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6e380a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3445:x1869324939746176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (2855us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727423.679268:0:6953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1782727423.679304:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e0d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869324939746176:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782727423.680194:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e0f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3445:1869324939746688:0@lo:400:kworker.0 00000100:00100000:3.0:1782727423.680250:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727423.680282:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782727423.680287:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e0fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3445:1869324939746560:0@lo:400:kworker.0 00000100:00100000:3.0:1782727423.680308:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727423.680823:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e0f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c71e9f0f-6441-4b9b-bc96-153ab9250801:3442:1869324939746304:0@lo:400:kworker.0 00000100:00100000:0.0:1782727423.680864:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727423.680929:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782727423.680935:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e0f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3442:1869324939746432:0@lo:400:kworker.0 00000100:00100000:0.0:1782727423.681172:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727423.682143:0:12227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939746688 00000100:00100000:1.0:1782727423.682152:0:12227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939746688 00000100:00100000:1.0:1782727423.682209:0:12227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939746560 00000100:00100000:1.0:1782727423.682212:0:12227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939746560 00000100:00100000:1.0:1782727423.682226:0:12227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939746432 00000100:00100000:1.0:1782727423.682229:0:12227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939746432 00000100:00100000:1.0:1782727423.682258:0:12227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1782727423.682268:0:12227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1869324939746688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727423.682352:0:12227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1869324939746688:12345-0@lo:400:kworker.0 Request processed in 86us (2101us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727423.682359:0:12227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1782727423.682377:0:12227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1782727423.682382:0:12227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3445:x1869324939746560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727423.682409:0:12227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3445:x1869324939746560:12345-0@lo:400:kworker.0 Request processed in 27us (2100us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727423.682415:0:12227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1782727423.682426:0:12227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1782727423.682431:0:12227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e1eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1869324939746432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727423.682462:0:12227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e1eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1869324939746432:12345-0@lo:400:kworker.0 Request processed in 31us (1291us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727423.682468:0:12227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1782727423.682510:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e0f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3442:1869324939746432:0@lo:400:kworker.0 00000100:00100000:1.0:1782727423.682546:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e0fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3445:1869324939746560:0@lo:400:kworker.0 00000100:00100000:1.0:1782727423.682571:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e0f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3445:1869324939746688:0@lo:400:kworker.0 00000100:00080000:1.0:1782727423.683148:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782727423.683153:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782727423.684821:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939746304 00000100:00100000:3.0:1782727423.684833:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939746304 00000100:00100000:3.0:1782727423.684904:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1782727423.684915:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5d072850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:3442:x1869324939746304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727423.684992:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5d072850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:3442:x1869324939746304:12345-0@lo:400:kworker.0 Request processed in 80us (4127us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727423.685010:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1782727423.685069:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e0f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c71e9f0f-6441-4b9b-bc96-153ab9250801:3442:1869324939746304:0@lo:400:kworker.0 00000100:00100000:3.0:1782727424.004375:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1782727424.004421:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1782727424.004461:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1782727424.004566:0:6951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914542720 00000100:00100000:2.0:1782727424.004575:0:6951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914542720 00000100:00100000:2.0:1782727424.004645:0:6951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 42 00000100:00100000:2.0:1782727424.004656:0:6951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d85bc959-008e-4782-8f39-df709fbb4636+5:2358:x1869324914542720:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1782727424.004745:0:6951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d85bc959-008e-4782-8f39-df709fbb4636+5:2358:x1869324914542720:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 91us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727424.004753:0:6951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 42 00000100:00100000:1.0:1782727424.004830:0:12227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914542592 00000100:00100000:1.0:1782727424.004835:0:12227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914542592 00000100:00100000:1.0:1782727424.004877:0:12227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 113 00000100:00100000:1.0:1782727424.004912:0:12227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d85bc959-008e-4782-8f39-df709fbb4636+5:2358:x1869324914542592:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1782727424.004943:0:12227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d85bc959-008e-4782-8f39-df709fbb4636+5:2358:x1869324914542592:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 60us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727424.004962:0:12227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 113 00000100:00100000:0.0:1782727424.005033:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914542464 00000100:00100000:0.0:1782727424.005038:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914542464 00000100:00100000:0.0:1782727424.005077:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 244 00000100:00100000:0.0:1782727424.005084:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5d070450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecaf1fda-ff42-4054-9f39-8e142296107b+10:2358:x1869324914542464:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1782727424.005109:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5d070450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecaf1fda-ff42-4054-9f39-8e142296107b+10:2358:x1869324914542464:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 26us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727424.005126:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 244 00000100:00080000:3.0:1782727424.008487:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782727424.008497:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1782727424.507752:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727425.094728:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1782727425.094813:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914542848 00000100:00100000:3.0:1782727425.094824:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914542848 00000100:00100000:3.0:1782727425.094917:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 31 00000100:00100000:3.0:1782727425.094928:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e1ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d85bc959-008e-4782-8f39-df709fbb4636+5:10951:x1869324914542848:12345-192.168.202.60@tcp:101:dd.0 00010000:00010000:3.0:1782727425.094948:0:5950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727425.095034:0:5950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151cc00/0x14a47870ee88ce1a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1752a87bbfbdf114 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.095112:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151da00/0x14a47870ee88ce21 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.095127:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151da00/0x14a47870ee88ce21 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.095139:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151da00/0x14a47870ee88ce21 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782727425.095188:0:5950:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1782727425.095192:0:5950:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782727425.095230:0:5950:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151da00/0x14a47870ee88ce21 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.095256:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151cc00/0x14a47870ee88ce1a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf114 expref: 7 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.095274:0:5950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151da00/0x14a47870ee88ce21 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf114 expref: 6 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.095281:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921c5fdb5e00) 00010000:00010000:3.0:1782727425.095285:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782727425.095287:0:5950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c4151da00, rc 0) 00000100:00100000:3.0:1782727425.095343:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e1ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d85bc959-008e-4782-8f39-df709fbb4636+6:10951:x1869324914542848:12345-192.168.202.60@tcp:101:dd.0 Request processed in 417us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727425.095351:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 31 00000100:00100000:3.0:1782727425.099287:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1782727425.099380:0:12227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914543104 00000100:00100000:1.0:1782727425.099390:0:12227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914543104 00000100:00100000:1.0:1782727425.099450:0:12227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 32 00000100:00100000:1.0:1782727425.099461:0:12227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d85bc959-008e-4782-8f39-df709fbb4636+6:10951:x1869324914543104:12345-192.168.202.60@tcp:101:dd.0 00010000:00010000:1.0:1782727425.099483:0:12227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727425.099486:0:12227:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1782727425.099511:0:12227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151da00/0x14a47870ee88ce21 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf114 expref: 6 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727425.099530:0:12227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921c5fdb5e00) 00010000:00010000:1.0:1782727425.099542:0:12227:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782727425.099557:0:12227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669600/0x14a47870ee88ce28 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1752a87bbfbdf11b expref: -99 pid: 12227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727425.099654:0:12227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669c00/0x14a47870ee88ce2f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727425.099668:0:12227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669c00/0x14a47870ee88ce2f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727425.099677:0:12227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669c00/0x14a47870ee88ce2f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727425.099745:0:12227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669400/0x14a47870ee88ce36 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727425.099753:0:12227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669400/0x14a47870ee88ce36 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727425.099770:0:12227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669400/0x14a47870ee88ce36 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782727425.100162:0:12227:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:1.0:1782727425.100297:0:12227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669e00/0x14a47870ee88ce3d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727425.100307:0:12227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669e00/0x14a47870ee88ce3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727425.100314:0:12227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669e00/0x14a47870ee88ce3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727425.100346:0:12227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669c00/0x14a47870ee88ce2f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727425.100353:0:12227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669c00/0x14a47870ee88ce2f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727425.100359:0:12227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669c00/0x14a47870ee88ce2f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727425.100365:0:12227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c76669c00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1782727425.100370:0:12227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669c00/0x14a47870ee88ce2f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727425.100378:0:12227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669c00/0x14a47870ee88ce2f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727425.100386:0:12227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921c5fda7000) 00010000:00010000:1.0:1782727425.100389:0:12227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782727425.100400:0:12227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669c00/0x14a47870ee88ce2f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727425.100406:0:12227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669c00/0x14a47870ee88ce2f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782727425.100421:0:12227:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d9afe338 reply state 000000008847139b transno 4294967309 ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669400/0x14a47870ee88ce36 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727425.100430:0:12227:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782727425.100456:0:12227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669600/0x14a47870ee88ce28 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf11b expref: 8 pid: 12227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727425.100475:0:12227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669e00/0x14a47870ee88ce3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf11b expref: 7 pid: 12227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727425.100483:0:12227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff921c5fda7800) 00010000:00010000:1.0:1782727425.100485:0:12227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782727425.100488:0:12227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c76669e00, rc 0) 00000100:00100000:1.0:1782727425.100556:0:12227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d85bc959-008e-4782-8f39-df709fbb4636+8:10951:x1869324914543104:12345-192.168.202.60@tcp:101:dd.0 Request processed in 1097us (1278us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1782727425.100564:0:12227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 32 00010000:00010000:0.0:1782727425.108701:0:3428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669400/0x14a47870ee88ce36 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727425.108719:0:3428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669400/0x14a47870ee88ce36 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727425.108735:0:3428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669400/0x14a47870ee88ce36 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727425.108741:0:3428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c76669400 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:0.0:1782727425.108746:0:3428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669400/0x14a47870ee88ce36 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727425.108753:0:3428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669400/0x14a47870ee88ce36 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727425.108768:0:3428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd143313f (ffff921c5fda7600) 00010000:00010000:0.0:1782727425.108770:0:3428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782727425.108775:0:3428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669400/0x14a47870ee88ce36 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727425.108780:0:3428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669400/0x14a47870ee88ce36 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727425.123559:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1782727425.123995:0:6949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914543232 00000100:00100000:2.0:1782727425.124004:0:6949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914543232 00000100:00100000:2.0:1782727425.124053:0:6949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 15 00000100:00100000:2.0:1782727425.124070:0:6949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2354:x1869324914543232:12345-192.168.202.60@tcp:8:dd.0 00010000:00080000:2.0:1782727425.124100:0:6949:0:(ldlm_lib.c:1434:target_handle_connect()) lustre-OST0000: connection from d85bc959-008e-4782-8f39-df709fbb4636@192.168.202.60@tcp t0 exp 0000000000000000 cur 319 last 0 00000020:00000080:2.0:1782727425.124138:0:6949:0:(genops.c:1406:class_connect()) connect: client d85bc959-008e-4782-8f39-df709fbb4636, cookie 0x14a47870ee88ce4b 00002000:00100000:2.0:1782727425.124150:0:6949:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d85bc959-008e-4782-8f39-df709fbb4636/ffff921c7df1f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1782727425.124161:0:6949:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1782727425.124233:0:6949:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1782727425.124262:0:6949:0:(import.c:65:import_set_state_nolock()) ffff921c7df18800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782727425.124325:0:6949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d85bc959-008e-4782-8f39-df709fbb4636+6:2354:x1869324914543232:12345-192.168.202.60@tcp:8:dd.0 Request processed in 254us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727425.124333:0:6949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 15 00000100:00100000:3.0:1782727425.139870:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1782727425.151461:0:6951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914543360 00000100:00100000:2.0:1782727425.151476:0:6951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914543360 00000100:00100000:3.0:1782727425.151642:0:6951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 16 00000100:00100000:3.0:1782727425.151654:0:6951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d85bc959-008e-4782-8f39-df709fbb4636+6:10951:x1869324914543360:12345-192.168.202.60@tcp:101:dd.0 00010000:00010000:3.0:1782727425.151672:0:6951:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727425.151697:0:6951:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000000cd5259/0x14a47870ee88ce52 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1752a87bbfbdf122 expref: -99 pid: 6951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782727425.151721:0:6951:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782727425.151741:0:6951:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=319s v=(0 0) 00010000:00010000:3.0:1782727425.151745:0:6951:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782727425.151754:0:6951:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000cd5259/0x14a47870ee88ce52 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf122 expref: 7 pid: 6951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.151774:0:6951:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000000cd5259/0x14a47870ee88ce52 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf122 expref: 7 pid: 6951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.151787:0:6951:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c4151cc00, rc 0) 00000100:00100000:3.0:1782727425.151852:0:6951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d85bc959-008e-4782-8f39-df709fbb4636+7:10951:x1869324914543360:12345-192.168.202.60@tcp:101:dd.0 Request processed in 199us (11991us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727425.151860:0:6951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 16 00000100:00080000:0.0:1782727425.152071:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782727425.167987:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1782727425.168095:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914543616 00000100:00100000:3.0:1782727425.168115:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914543616 00000100:00100000:3.0:1782727425.168174:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 6 00000100:00100000:3.0:1782727425.168186:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d85bc959-008e-4782-8f39-df709fbb4636+7:10951:x1869324914543616:12345-192.168.202.60@tcp:35:dd.0 00000100:00100000:3.0:1782727425.168480:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d85bc959-008e-4782-8f39-df709fbb4636+8:10951:x1869324914543616:12345-192.168.202.60@tcp:35:dd.0 Request processed in 295us (501us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1782727425.168501:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 6 00000100:00100000:3.0:1782727425.201374:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1782727425.201410:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914543744 00000100:00100000:3.0:1782727425.201421:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914543744 00000100:00100000:3.0:1782727425.201474:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 33 00000100:00100000:3.0:1782727425.201484:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d85bc959-008e-4782-8f39-df709fbb4636+8:10952:x1869324914543744:12345-192.168.202.60@tcp:101:rm.0 00010000:00010000:3.0:1782727425.201510:0:5950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727425.201530:0:5950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151c200/0x14a47870ee88ce59 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1752a87bbfbdf129 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.204279:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151da00/0x14a47870ee88ce60 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.204298:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151da00/0x14a47870ee88ce60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.204309:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151da00/0x14a47870ee88ce60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782727425.204360:0:5950:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1782727425.204364:0:5950:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782727425.204386:0:5950:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151da00/0x14a47870ee88ce60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.204413:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151c200/0x14a47870ee88ce59 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf129 expref: 10 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.204429:0:5950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151da00/0x14a47870ee88ce60 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf129 expref: 9 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.204450:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921c5fdb5a00) 00010000:00010000:3.0:1782727425.204453:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782727425.204457:0:5950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c4151da00, rc 0) 00000100:00100000:3.0:1782727425.204529:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d85bc959-008e-4782-8f39-df709fbb4636+9:10952:x1869324914543744:12345-192.168.202.60@tcp:101:rm.0 Request processed in 3044us (3174us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727425.204616:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 33 00000001:00080000:3.0:1782727425.229763:0:8019:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000100:00100000:3.0:1782727425.229848:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1782727425.231244:0:12227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914544000 00000100:00100000:3.0:1782727425.231256:0:12227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914544000 00000100:00100000:3.0:1782727425.231318:0:12227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 34 00000100:00100000:3.0:1782727425.231329:0:12227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d85bc959-008e-4782-8f39-df709fbb4636+9:10952:x1869324914544000:12345-192.168.202.60@tcp:36:rm.0 00010000:00010000:3.0:1782727425.231387:0:12227:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1782727425.231413:0:12227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669e00/0x14a47870ee88ce3d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf11b expref: 9 pid: 12227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.231432:0:12227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff921c5fda7800) 00010000:00010000:3.0:1782727425.231449:0:12227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151da00/0x14a47870ee88ce60 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf129 expref: 8 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.231457:0:12227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921c5fdb5a00) 00010000:00010000:3.0:1782727425.231462:0:12227:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782727425.231485:0:12227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151c800/0x14a47870ee88ce67 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.231497:0:12227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151c800/0x14a47870ee88ce67 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.231521:0:12227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151c800/0x14a47870ee88ce67 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.232635:0:12227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151c200/0x14a47870ee88ce6e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.232653:0:12227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151c200/0x14a47870ee88ce6e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.232663:0:12227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151c200/0x14a47870ee88ce6e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.232759:0:12227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151d800/0x14a47870ee88ce75 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.232767:0:12227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151d800/0x14a47870ee88ce75 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.232773:0:12227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151d800/0x14a47870ee88ce75 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782727425.233005:0:12227:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1782727425.233015:0:12227:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 319991130861ns, next at 320991128881ns, rc = 0 00010000:00010000:3.0:1782727425.233065:0:12227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151ce00/0x14a47870ee88ce7c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.233074:0:12227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151ce00/0x14a47870ee88ce7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.233081:0:12227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151ce00/0x14a47870ee88ce7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.233115:0:12227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151ce00/0x14a47870ee88ce7c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.233121:0:12227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151ce00/0x14a47870ee88ce7c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.233127:0:12227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151ce00/0x14a47870ee88ce7c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.235327:0:12227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782727425.235357:0:12227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151d800/0x14a47870ee88ce75 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.235365:0:12227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151d800/0x14a47870ee88ce75 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.235372:0:12227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151d800/0x14a47870ee88ce75 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.235379:0:12227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c4151d800 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1782727425.235384:0:12227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151d800/0x14a47870ee88ce75 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.235391:0:12227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151d800/0x14a47870ee88ce75 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.235407:0:12227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff921c5fdb5c00) 00010000:00010000:3.0:1782727425.235410:0:12227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782727425.235415:0:12227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151d800/0x14a47870ee88ce75 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.235436:0:12227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151d800/0x14a47870ee88ce75 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.235456:0:12227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151c800/0x14a47870ee88ce67 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.235461:0:12227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151c800/0x14a47870ee88ce67 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.235467:0:12227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151c800/0x14a47870ee88ce67 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.235472:0:12227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c4151c800 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1782727425.235475:0:12227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151c800/0x14a47870ee88ce67 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.235481:0:12227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151c800/0x14a47870ee88ce67 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.235489:0:12227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921c5fdb5f00) 00010000:00010000:3.0:1782727425.235491:0:12227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782727425.235494:0:12227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151c800/0x14a47870ee88ce67 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.235500:0:12227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151c800/0x14a47870ee88ce67 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782727425.235516:0:12227:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000f198e16 reply state 00000000874153fd transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151c200/0x14a47870ee88ce6e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727425.235526:0:12227:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782727425.235633:0:5938:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782727425.235639:0:5938:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151ce00/0x14a47870ee88ce7c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727425.235646:0:5938:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c4151ce00 already unused, calling callback (ffffffffc0c98cf0) 00010000:00010000:1.0:1782727425.235649:0:5938:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151ce00/0x14a47870ee88ce7c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727425.235655:0:5938:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151ce00/0x14a47870ee88ce7c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727425.235671:0:5938:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff921c5fdb5c00) 00010000:00010000:1.0:1782727425.235673:0:5938:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1782727425.235676:0:5938:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151ce00/0x14a47870ee88ce7c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727425.235682:0:5938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151ce00/0x14a47870ee88ce7c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727425.235696:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727425.235697:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727425.235699:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727425.236741:0:12227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d85bc959-008e-4782-8f39-df709fbb4636+9:10952:x1869324914544000:12345-192.168.202.60@tcp:36:rm.0 Request processed in 5408us (6890us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1782727425.236751:0:12227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 34 00010000:00010000:3.0:1782727425.246093:0:3429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151c200/0x14a47870ee88ce6e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.247816:0:3429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151c200/0x14a47870ee88ce6e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.247826:0:3429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151c200/0x14a47870ee88ce6e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.247833:0:3429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c4151c200 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1782727425.247838:0:3429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151c200/0x14a47870ee88ce6e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.247847:0:3429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151c200/0x14a47870ee88ce6e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.247865:0:3429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd143313f (ffff921c5fdb5400) 00010000:00010000:3.0:1782727425.247868:0:3429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782727425.247872:0:3429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151c200/0x14a47870ee88ce6e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.247879:0:3429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151c200/0x14a47870ee88ce6e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727425.445224:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1782727425.445353:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914544128 00000100:00100000:0.0:1782727425.445362:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914544128 00000100:00100000:0.0:1782727425.445425:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 35 00000100:00100000:0.0:1782727425.445436:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d85bc959-008e-4782-8f39-df709fbb4636+8:10955:x1869324914544128:12345-192.168.202.60@tcp:101:multiop.0 00010000:00010000:0.0:1782727425.445459:0:5950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727425.445480:0:5950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1000/0x14a47870ee88ce83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1752a87bbfbdf130 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727425.445555:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1a00/0x14a47870ee88ce8a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727425.445587:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1a00/0x14a47870ee88ce8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727425.445599:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1a00/0x14a47870ee88ce8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782727425.445643:0:5950:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1782727425.445647:0:5950:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782727425.445680:0:5950:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1a00/0x14a47870ee88ce8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727425.445704:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1000/0x14a47870ee88ce83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf130 expref: 10 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727425.445722:0:5950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1a00/0x14a47870ee88ce8a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf130 expref: 9 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727425.445732:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921c58b4c300) 00010000:00010000:0.0:1782727425.445734:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782727425.445738:0:5950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c7a3e1a00, rc 0) 00000100:00100000:0.0:1782727425.445801:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d85bc959-008e-4782-8f39-df709fbb4636+9:10955:x1869324914544128:12345-192.168.202.60@tcp:101:multiop.0 Request processed in 367us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727425.445809:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 35 00000100:00100000:3.0:1782727425.455411:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1782727425.455776:0:12227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914544384 00000100:00100000:1.0:1782727425.455786:0:12227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914544384 00000100:00100000:1.0:1782727425.455850:0:12227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 36 00000100:00100000:1.0:1782727425.455860:0:12227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d85bc959-008e-4782-8f39-df709fbb4636+9:10955:x1869324914544384:12345-192.168.202.60@tcp:101:multiop.0 00010000:00010000:1.0:1782727425.455939:0:12227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727425.455943:0:12227:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1782727425.455968:0:12227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1a00/0x14a47870ee88ce8a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf130 expref: 9 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727425.455987:0:12227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921c58b4c300) 00010000:00010000:1.0:1782727425.455999:0:12227:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782727425.456015:0:12227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668e00/0x14a47870ee88ce91 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1752a87bbfbdf137 expref: -99 pid: 12227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727425.456121:0:12227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669200/0x14a47870ee88ce98 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727425.456144:0:12227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669200/0x14a47870ee88ce98 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727425.456167:0:12227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669200/0x14a47870ee88ce98 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727425.456182:0:12227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668c00/0x14a47870ee88ce9f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727425.456189:0:12227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668c00/0x14a47870ee88ce9f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727425.456196:0:12227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668c00/0x14a47870ee88ce9f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782727425.456466:0:12227:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:1.0:1782727425.456867:0:12227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668000/0x14a47870ee88cea6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727425.456878:0:12227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668000/0x14a47870ee88cea6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727425.460450:0:12227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668000/0x14a47870ee88cea6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727425.460521:0:12227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669200/0x14a47870ee88ce98 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727425.460529:0:12227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669200/0x14a47870ee88ce98 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727425.460876:0:12227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669200/0x14a47870ee88ce98 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727425.460966:0:12227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c76669200 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1782727425.460987:0:12227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669200/0x14a47870ee88ce98 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727425.460998:0:12227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669200/0x14a47870ee88ce98 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727425.461013:0:12227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921c5fda7000) 00010000:00010000:1.0:1782727425.461017:0:12227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782727425.461022:0:12227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669200/0x14a47870ee88ce98 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727425.461029:0:12227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669200/0x14a47870ee88ce98 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782727425.461048:0:12227:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000611982f0 reply state 00000000a181c6a9 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668c00/0x14a47870ee88ce9f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727425.461058:0:12227:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782727425.461117:0:12227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668e00/0x14a47870ee88ce91 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf137 expref: 11 pid: 12227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727425.461151:0:12227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668000/0x14a47870ee88cea6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf137 expref: 10 pid: 12227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727425.461159:0:12227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff921c5fda7200) 00010000:00010000:1.0:1782727425.461161:0:12227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782727425.461164:0:12227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c76668000, rc 0) 00000100:00100000:1.0:1782727425.461252:0:12227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d85bc959-008e-4782-8f39-df709fbb4636+11:10955:x1869324914544384:12345-192.168.202.60@tcp:101:multiop.0 Request processed in 5394us (5850us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1782727425.461261:0:12227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 36 00010000:00010000:0.0:1782727425.465213:0:3428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668c00/0x14a47870ee88ce9f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727425.465231:0:3428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668c00/0x14a47870ee88ce9f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727425.465257:0:3428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668c00/0x14a47870ee88ce9f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727425.465263:0:3428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c76668c00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:0.0:1782727425.465268:0:3428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668c00/0x14a47870ee88ce9f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727425.465275:0:3428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668c00/0x14a47870ee88ce9f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727425.465290:0:3428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd143313f (ffff921c5fda7f00) 00010000:00010000:0.0:1782727425.465293:0:3428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782727425.465297:0:3428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668c00/0x14a47870ee88ce9f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727425.465304:0:3428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668c00/0x14a47870ee88ce9f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727425.480318:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1782727425.480392:0:6949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914544512 00000100:00100000:2.0:1782727425.480403:0:6949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914544512 00000100:00100000:2.0:1782727425.480470:0:6949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 17 00000100:00100000:2.0:1782727425.480481:0:6949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d85bc959-008e-4782-8f39-df709fbb4636+5:10955:x1869324914544512:12345-192.168.202.60@tcp:101:multiop.0 00010000:00010000:2.0:1782727425.480499:0:6949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727425.480525:0:6949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000073f0791c/0x14a47870ee88ceb4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1752a87bbfbdf13e expref: -99 pid: 6949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782727425.480550:0:6949:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1782727425.480570:0:6949:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=320s v=(0 0) 00010000:00010000:2.0:1782727425.480574:0:6949:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782727425.480583:0:6949:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073f0791c/0x14a47870ee88ceb4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf13e expref: 6 pid: 6949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727425.480635:0:6949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000073f0791c/0x14a47870ee88ceb4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf13e expref: 6 pid: 6949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727425.480649:0:6949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c429d5a00, rc 0) 00000100:00100000:2.0:1782727425.480715:0:6949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d85bc959-008e-4782-8f39-df709fbb4636+6:10955:x1869324914544512:12345-192.168.202.60@tcp:101:multiop.0 Request processed in 235us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727425.480730:0:6949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 17 00000100:00100000:1.0:1782727425.525186:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1782727425.525316:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914544640 00000100:00100000:0.0:1782727425.525616:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914544640 00000100:00100000:0.0:1782727425.525682:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 37 00000100:00100000:0.0:1782727425.525693:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6e380000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d85bc959-008e-4782-8f39-df709fbb4636+10:10955:x1869324914544640:12345-192.168.202.60@tcp:44:multiop.0 00000001:00080000:2.0:1782727425.527859:0:5929:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967312 is committed 00000004:00080000:2.0:1782727425.527872:0:5929:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:1.0:1782727425.528057:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e0fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869324939746816:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782727425.528129:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727425.529736:0:6951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939746816 00000100:00100000:3.0:1782727425.529758:0:6951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939746816 00000100:00080000:3.0:1782727425.529788:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782727425.529826:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6e380000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d85bc959-008e-4782-8f39-df709fbb4636+6:10955:x1869324914544640:12345-192.168.202.60@tcp:44:multiop.0 Request processed in 4130us (4645us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727425.529831:0:9464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1782727425.529836:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 37 00000100:00100000:3.0:1782727425.529839:0:9464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6e383100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3442:x1869324939746816:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1782727425.529864:0:9464:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00010000:00010000:3.0:1782727425.529913:0:9464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006578b833/0x14a47870ee88cebb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.529934:0:9464:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000000cd5259/0x14a47870ee88ce52 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf122 expref: 6 pid: 6951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.529944:0:9464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1782727425.529948:0:9464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782727425.529952:0:9464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006578b833/0x14a47870ee88cebb lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.529985:0:9464:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000000cd5259/0x14a47870ee88ce52 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf122 expref: 6 pid: 6951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727425.529998:0:9464:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000000cd5259/0x14a47870ee88ce52 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf122 expref: 6 pid: 6951 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727425.530012:0:9464:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e42d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9464:1869324939746944:192.168.202.60@tcp:104: 00000100:00100000:3.0:1782727425.530057:0:9464:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c7d9546c0 going to sleep for 11 seconds 00010000:00010000:2.0:1782727425.532736:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727425.534711:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1782727425.534832:0:6950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914544768 00000100:00100000:3.0:1782727425.534841:0:6950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914544768 00000100:00100000:3.0:1782727425.534920:0:6950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 19 00000100:00100000:3.0:1782727425.534970:0:6950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e1ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d85bc959-008e-4782-8f39-df709fbb4636+6:2358:x1869324914544768:12345-192.168.202.60@tcp:16:multiop.0 00000100:00100000:3.0:1782727425.535094:0:6950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e1ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d85bc959-008e-4782-8f39-df709fbb4636+6:2358:x1869324914544768:12345-192.168.202.60@tcp:16:multiop.0 Request processed in 163us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727425.535110:0:6950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 19 00000100:00100000:3.0:1782727425.537470:0:9464:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e42d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9464:1869324939746944:192.168.202.60@tcp:104: 00010000:00010000:3.0:1782727425.537500:0:9464:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006578b833/0x14a47870ee88cebb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727425.545625:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1782727425.545732:0:5934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914544896 00000100:00100000:1.0:1782727425.545742:0:5934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914544896 00010000:00010000:1.0:1782727425.545782:0:5934:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000000cd5259/0x14a47870ee88ce52 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf122 expref: 7 pid: 6951 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727425.545829:0:5934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 29 00000100:00100000:1.0:1782727425.545840:0:5934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e1eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d85bc959-008e-4782-8f39-df709fbb4636+7:2357:x1869324914544896:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782727425.545856:0:5934:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782727425.545862:0:5934:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000000cd5259/0x14a47870ee88ce52 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf122 expref: 7 pid: 6951 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727425.545876:0:5934:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000000cd5259/0x14a47870ee88ce52 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf122 expref: 7 pid: 6951 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727425.545944:0:5934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000cd5259/0x14a47870ee88ce52 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf122 expref: 7 pid: 6951 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727425.545961:0:5934:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782727425.545965:0:5934:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782727425.545971:0:5934:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006578b833/0x14a47870ee88cebb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727425.545980:0:5934:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006578b833/0x14a47870ee88cebb lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727425.546037:0:5934:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782727425.546097:0:5934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e1eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d85bc959-008e-4782-8f39-df709fbb4636+6:2357:x1869324914544896:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 258us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727425.546113:0:5934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 29 00010000:00010000:2.0:1782727425.546552:0:9464:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006578b833/0x14a47870ee88cebb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727425.546563:0:9464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006578b833/0x14a47870ee88cebb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727425.546573:0:9464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006578b833/0x14a47870ee88cebb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727425.546579:0:9464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006578b833/0x14a47870ee88cebb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727425.546609:0:9464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782727425.546733:0:8027:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782727425.546746:0:8027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006578b833/0x14a47870ee88cebb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727425.546754:0:8027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c4151c200 already unused, calling callback (ffffffffc0c98cf0) 00010000:00010000:0.0:1782727425.546758:0:8027:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006578b833/0x14a47870ee88cebb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727425.546766:0:8027:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006578b833/0x14a47870ee88cebb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727425.546779:0:8027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006578b833/0x14a47870ee88cebb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727425.546786:0:8027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006578b833/0x14a47870ee88cebb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727425.546805:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727425.546807:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727425.546809:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727425.547354:0:9464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6e383100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3442:x1869324939746816:12345-0@lo:6:osp-syn-0-0.0 Request processed in 17514us (19222us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1782727425.547383:0:9464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:1.0:1782727425.547435:0:3442:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff921c7e0fb480/2, rc 0, transno 4294967299 00000100:00100000:1.0:1782727425.547442:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e0fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869324939746816:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782727425.551414:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1782727425.551579:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914545152 00000100:00100000:3.0:1782727425.551589:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914545152 00000100:00100000:3.0:1782727425.551644:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 7 00000100:00100000:3.0:1782727425.551654:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6e380e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d85bc959-008e-4782-8f39-df709fbb4636+6:10955:x1869324914545152:12345-192.168.202.60@tcp:35:multiop.0 00000100:00100000:3.0:1782727425.552008:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6e380e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d85bc959-008e-4782-8f39-df709fbb4636+7:10955:x1869324914545152:12345-192.168.202.60@tcp:35:multiop.0 Request processed in 355us (602us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1782727425.552017:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 7 00010000:00010000:1.0:1782727426.553152:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727427.577138:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727428.603630:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727428.793228:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c45e42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c71e9f0f-6441-4b9b-bc96-153ab9250801:3443:1869324939747072:0@lo:400:kworker.0 00000100:00100000:3.0:1782727428.793312:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727428.793395:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c76443b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3443:1869324939747584:0@lo:400:kworker.0 00000100:00100000:3.0:1782727428.793421:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727428.793446:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1782727428.793453:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c76442680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869324939747456:0@lo:400:kworker.0 00000100:00100000:3.0:1782727428.793478:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727428.793587:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e0d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869324939747968:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782727428.793612:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727428.793642:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c76440e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869324939747200:0@lo:400:kworker.0 00000100:00100000:3.0:1782727428.793730:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727428.793749:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7dff8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869324939747712:0@lo:400:kworker.0 00000100:00100000:3.0:1782727428.793769:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727428.793786:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1782727428.793792:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c76443100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3444:1869324939747328:0@lo:400:kworker.0 00000100:00100000:3.0:1782727428.793812:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727428.793826:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7dffa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869324939747840:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782727428.793844:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727428.793874:0:12227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939747584 00000100:00100000:3.0:1782727428.793982:0:12227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939747584 00000100:00100000:3.0:1782727428.794037:0:12227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939747200 00000100:00100000:3.0:1782727428.794040:0:12227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939747200 00000100:00100000:3.0:1782727428.794052:0:12227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939747328 00000100:00100000:3.0:1782727428.794054:0:12227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939747328 00000100:00100000:3.0:1782727428.794081:0:12227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1782727428.794090:0:12227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1869324939747584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727428.794142:0:12227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1869324939747584:12345-0@lo:400:kworker.0 Request processed in 52us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727428.794149:0:12227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1782727428.794171:0:12227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1782727428.794177:0:12227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dffb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869324939747200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727428.794207:0:12227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dffb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869324939747200:12345-0@lo:400:kworker.0 Request processed in 29us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727428.794213:0:12227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1782727428.794223:0:12227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1782727428.794228:0:12227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e13df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869324939747328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727428.794262:0:12227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e13df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869324939747328:12345-0@lo:400:kworker.0 Request processed in 33us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727428.794268:0:12227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1782727428.794287:0:6953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939747968 00000100:00100000:3.0:1782727428.794291:0:6953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939747968 00000100:00100000:3.0:1782727428.794310:0:6953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939747840 00000100:00100000:3.0:1782727428.794312:0:6953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939747840 00000100:00100000:3.0:1782727428.794324:0:6953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1782727428.794329:0:6953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dffbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1869324939747968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782727428.794350:0:6953:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1782727428.794381:0:6953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dffbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1869324939747968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727428.794386:0:6953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1782727428.794398:0:6953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1782727428.794404:0:6953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e13c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3444:x1869324939747840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782727428.794420:0:6953:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1782727428.794444:0:6953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e13c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3444:x1869324939747840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 40us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727428.794450:0:6953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1782727428.794470:0:6949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939747456 00000100:00100000:3.0:1782727428.794474:0:6949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939747456 00000100:00100000:3.0:1782727428.794492:0:6949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939747712 00000100:00100000:3.0:1782727428.794495:0:6949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939747712 00000100:00100000:3.0:1782727428.794511:0:6949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1782727428.794516:0:6949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dff8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3443:x1869324939747456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727428.794545:0:6949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dff8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3443:x1869324939747456:12345-0@lo:400:kworker.0 Request processed in 29us (1066us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727428.794559:0:6949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1782727428.794570:0:6949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1782727428.794576:0:6949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dff9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324939747712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727428.794602:0:6949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dff9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324939747712:12345-0@lo:400:kworker.0 Request processed in 26us (832us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727428.794607:0:6949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:3.0:1782727428.794629:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782727428.794634:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782727428.794636:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782727428.794728:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c76443100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3444:1869324939747328:0@lo:400:kworker.0 00000100:00100000:3.0:1782727428.794745:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7dffa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869324939747840:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782727428.794754:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c76440e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869324939747200:0@lo:400:kworker.0 00000100:00100000:3.0:1782727428.794762:0:3444:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:3.0:1782727428.794767:0:3444:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff921c7e1ee300, transno 4294967300 00000100:00100000:3.0:1782727428.794929:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7dff8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869324939747712:0@lo:400:kworker.0 00000100:00100000:3.0:1782727428.794969:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c76442680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869324939747456:0@lo:400:kworker.0 00000100:00100000:3.0:1782727428.794980:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e0d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869324939747968:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782727428.794990:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c76443b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3443:1869324939747584:0@lo:400:kworker.0 00000100:00100000:2.0:1782727428.795084:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939747072 00000100:00100000:2.0:1782727428.795089:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939747072 00000100:00100000:2.0:1782727428.795160:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1782727428.795168:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5d070850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:3443:x1869324939747072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727428.795211:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5d070850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:3443:x1869324939747072:12345-0@lo:400:kworker.0 Request processed in 44us (1900us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727428.795218:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1782727428.795393:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c45e42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c71e9f0f-6441-4b9b-bc96-153ab9250801:3443:1869324939747072:0@lo:400:kworker.0 00000100:00100000:0.0:1782727429.121618:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1782727429.121756:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914545280 00000100:00100000:1.0:1782727429.121767:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914545280 00000100:00100000:1.0:1782727429.121831:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 246 00000100:00100000:1.0:1782727429.121843:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6e0fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecaf1fda-ff42-4054-9f39-8e142296107b+10:2355:x1869324914545280:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1782727429.122015:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6e0fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecaf1fda-ff42-4054-9f39-8e142296107b+10:2355:x1869324914545280:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 173us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727429.122022:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 246 00000100:00100000:1.0:1782727429.126631:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1782727429.126672:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1782727429.126700:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1782727429.126769:0:12227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914545408 00000100:00100000:2.0:1782727429.126778:0:12227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914545408 00000100:00100000:2.0:1782727429.126846:0:12227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 117 00000100:00100000:2.0:1782727429.126854:0:12227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6e380380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d85bc959-008e-4782-8f39-df709fbb4636+7:2355:x1869324914545408:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1782727429.126959:0:12227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6e380380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d85bc959-008e-4782-8f39-df709fbb4636+7:2355:x1869324914545408:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 105us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727429.126967:0:12227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 117 00000100:00100000:3.0:1782727429.127024:0:6951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914545536 00000100:00100000:3.0:1782727429.127027:0:6951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914545536 00000100:00100000:3.0:1782727429.127054:0:6951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914545664 00000100:00100000:3.0:1782727429.127056:0:6951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914545664 00000100:00100000:3.0:1782727429.127079:0:6951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 45 00000100:00100000:3.0:1782727429.127086:0:6951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6e383800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d85bc959-008e-4782-8f39-df709fbb4636+6:2355:x1869324914545536:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1782727429.127180:0:6950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 46 00000100:00100000:2.0:1782727429.127189:0:6950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6e383480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d85bc959-008e-4782-8f39-df709fbb4636+6:2355:x1869324914545664:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1782727429.127219:0:6950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6e383480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d85bc959-008e-4782-8f39-df709fbb4636+6:2355:x1869324914545664:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 32us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727429.127226:0:6950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 46 00000100:00100000:3.0:1782727429.127297:0:6951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6e383800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d85bc959-008e-4782-8f39-df709fbb4636+6:2355:x1869324914545536:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 212us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727429.127304:0:6951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 45 00000100:00080000:1.0:1782727429.127367:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782727429.127371:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782727429.127373:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782727429.628920:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727430.650181:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727430.927446:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1782727430.927551:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914545792 00000100:00100000:3.0:1782727430.927561:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914545792 00000100:00100000:3.0:1782727430.927627:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 38 00000100:00100000:3.0:1782727430.927638:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d85bc959-008e-4782-8f39-df709fbb4636+7:11193:x1869324914545792:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:3.0:1782727430.927660:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727430.927682:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151c800/0x14a47870ee88cec2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1752a87bbfbdf145 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727430.927746:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151d800/0x14a47870ee88cec9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727430.927760:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151d800/0x14a47870ee88cec9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727430.927769:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151d800/0x14a47870ee88cec9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782727430.927978:0:5949:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1782727430.927982:0:5949:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782727430.928030:0:5949:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151d800/0x14a47870ee88cec9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727430.928063:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151c800/0x14a47870ee88cec2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf145 expref: 9 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727430.928082:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151d800/0x14a47870ee88cec9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf145 expref: 8 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727430.928097:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921c5fdb5a00) 00010000:00010000:3.0:1782727430.928100:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782727430.928103:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c4151d800, rc 0) 00000100:00100000:3.0:1782727430.928168:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d85bc959-008e-4782-8f39-df709fbb4636+8:11193:x1869324914545792:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 531us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727430.928174:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 38 00000100:00100000:0.0:1782727430.945744:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1782727430.945918:0:12227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914545920 00000100:00100000:2.0:1782727430.945929:0:12227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914545920 00000100:00100000:2.0:1782727430.945991:0:12227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 39 00000100:00100000:2.0:1782727430.946002:0:12227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e1ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d85bc959-008e-4782-8f39-df709fbb4636+8:11193:x1869324914545920:12345-192.168.202.60@tcp:41:lfs.0 00000004:00000024:2.0:1782727430.946061:0:12227:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446338560 avail 1300099072 00000100:00100000:2.0:1782727430.946147:0:12227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e1ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d85bc959-008e-4782-8f39-df709fbb4636+8:11193:x1869324914545920:12345-192.168.202.60@tcp:41:lfs.0 Request processed in 146us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727430.946155:0:12227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 39 00000100:00100000:1.0:1782727430.963935:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1782727430.964065:0:6953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914546048 00000100:00100000:3.0:1782727430.964074:0:6953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914546048 00000100:00100000:3.0:1782727430.964133:0:6953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 58 00000100:00100000:3.0:1782727430.964142:0:6953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7d6e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d85bc959-008e-4782-8f39-df709fbb4636+6:11193:x1869324914546048:12345-192.168.202.60@tcp:13:lfs.0 00002000:00000024:3.0:1782727430.964176:0:6953:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1782727430.964267:0:6953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7d6e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d85bc959-008e-4782-8f39-df709fbb4636+6:11193:x1869324914546048:12345-192.168.202.60@tcp:13:lfs.0 Request processed in 124us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727430.964274:0:6953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 58 00000100:00100000:1.0:1782727430.968388:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1782727430.968562:0:6953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914546176 00000100:00100000:3.0:1782727430.968631:0:6953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914546176 00000100:00100000:3.0:1782727430.968731:0:6953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 59 00000100:00100000:3.0:1782727430.968741:0:6953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7d6e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d85bc959-008e-4782-8f39-df709fbb4636+6:11193:x1869324914546176:12345-192.168.202.60@tcp:13:lfs.0 00002000:00000024:3.0:1782727430.968778:0:6953:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1782727430.968971:0:6953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7d6e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d85bc959-008e-4782-8f39-df709fbb4636+6:11193:x1869324914546176:12345-192.168.202.60@tcp:13:lfs.0 Request processed in 230us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727430.968979:0:6953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 59 00000001:00080000:2.0:1782727431.355270:0:5929:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967313 is committed 00000001:00080000:0.0:1782727431.357377:0:6943:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:0.0:1782727431.357390:0:6943:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d85bc959-008e-4782-8f39-df709fbb4636 00010000:00010000:0.0:1782727431.673228:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727432.702790:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727433.724264:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727433.914584:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e0d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c71e9f0f-6441-4b9b-bc96-153ab9250801:3443:1869324939748096:0@lo:400:kworker.0 00000100:00100000:2.0:1782727433.914652:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727433.914719:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939748096 00000100:00100000:2.0:1782727433.914727:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939748096 00000100:00100000:2.0:1782727433.914780:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1782727433.914790:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6e0fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:3443:x1869324939748096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727433.914844:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6e0fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:3443:x1869324939748096:12345-0@lo:400:kworker.0 Request processed in 55us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727433.914851:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1782727433.914916:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e0d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c71e9f0f-6441-4b9b-bc96-153ab9250801:3443:1869324939748096:0@lo:400:kworker.0 00000100:00100000:2.0:1782727433.914968:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782727433.914974:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e0d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869324939748480:0@lo:400:kworker.0 00000100:00100000:2.0:1782727433.915002:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727433.915039:0:6950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939748480 00000100:00100000:2.0:1782727433.915044:0:6950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939748480 00000100:00100000:2.0:1782727433.915096:0:6950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1782727433.915104:0:6950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c45e42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3443:x1869324939748480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727433.915155:0:6950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c45e42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3443:x1869324939748480:12345-0@lo:400:kworker.0 Request processed in 52us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727433.915162:0:6950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1782727433.915188:0:3443:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000004:00080000:2.0:1782727433.915193:0:3443:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff921c7e0fb480, transno 4294967299 00000100:00100000:2.0:1782727433.915203:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e0d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869324939748480:0@lo:400:kworker.0 00000100:00100000:2.0:1782727433.915230:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e0d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3443:1869324939748608:0@lo:400:kworker.0 00000100:00080000:0.0:1782727433.915233:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782727433.915255:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727433.915355:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939748608 00000100:00100000:0.0:1782727433.915364:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939748608 00000100:00100000:0.0:1782727433.915398:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1782727433.915405:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7df63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1869324939748608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727433.915443:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7df63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1869324939748608:12345-0@lo:400:kworker.0 Request processed in 38us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727433.915449:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1782727433.915478:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e0d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3443:1869324939748608:0@lo:400:kworker.0 00000100:00080000:0.0:1782727433.915491:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782727433.915560:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e1ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869324939748992:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782727433.915606:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727433.915634:0:6952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939748992 00000100:00100000:0.0:1782727433.915638:0:6952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939748992 00000100:00100000:0.0:1782727433.915667:0:6952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1782727433.915672:0:6952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e1ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1869324939748992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782727433.915690:0:6952:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1782727433.915719:0:6952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e1ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1869324939748992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727433.915725:0:6952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:0.0:1782727433.915736:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782727433.915765:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e1ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869324939748992:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782727433.915796:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e0d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869324939748224:0@lo:400:kworker.0 00000100:00100000:0.0:1782727433.915818:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727433.915833:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7df63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869324939748736:0@lo:400:kworker.0 00000100:00100000:0.0:1782727433.915848:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727433.915860:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1782727433.915865:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e0d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3444:1869324939748352:0@lo:400:kworker.0 00000100:00100000:0.0:1782727433.916050:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727433.916066:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e1eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869324939748864:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782727433.916082:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727433.916101:0:12227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939748224 00000100:00100000:0.0:1782727433.916104:0:12227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939748224 00000100:00100000:0.0:1782727433.916122:0:12227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939748352 00000100:00100000:0.0:1782727433.916125:0:12227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939748352 00000100:00100000:0.0:1782727433.916140:0:12227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1782727433.916146:0:12227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e1ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869324939748224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727433.916174:0:12227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e1ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869324939748224:12345-0@lo:400:kworker.0 Request processed in 28us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727433.916180:0:12227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1782727433.916189:0:12227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1782727433.916195:0:12227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e1edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869324939748352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727433.916215:0:12227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e1edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869324939748352:12345-0@lo:400:kworker.0 Request processed in 20us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727433.916220:0:12227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:0.0:1782727433.916233:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782727433.916239:0:6952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939748864 00000100:00100000:0.0:1782727433.916242:0:6952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939748864 00000100:00100000:0.0:1782727433.916255:0:6952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1782727433.916261:0:6952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e1ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324939748864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782727433.916275:0:6952:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1782727433.916303:0:6952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e1ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324939748864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 42us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727433.916309:0:6952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1782727433.916335:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e0d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3444:1869324939748352:0@lo:400:kworker.0 00000100:00100000:0.0:1782727433.916356:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e1eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869324939748864:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782727433.916366:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e0d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869324939748224:0@lo:400:kworker.0 00000100:00100000:0.0:1782727433.916410:0:6951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939748736 00000100:00100000:0.0:1782727433.916413:0:6951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939748736 00000100:00100000:0.0:1782727433.916434:0:6951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1782727433.916441:0:6951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e1edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324939748736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727433.916476:0:6951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e1edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324939748736:12345-0@lo:400:kworker.0 Request processed in 35us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727433.916482:0:6951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1782727433.916506:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7df63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869324939748736:0@lo:400:kworker.0 00000100:00100000:3.0:1782727434.255152:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1782727434.255190:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1782727434.255223:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1782727434.255250:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1782727434.255278:0:12227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914546432 00000100:00100000:3.0:1782727434.255288:0:12227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914546432 00000100:00100000:3.0:1782727434.255352:0:12227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 121 00000100:00100000:3.0:1782727434.255363:0:12227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dff8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d85bc959-008e-4782-8f39-df709fbb4636+7:2358:x1869324914546432:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1782727434.255436:0:12227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dff8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d85bc959-008e-4782-8f39-df709fbb4636+7:2358:x1869324914546432:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 74us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727434.255444:0:12227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 121 00000100:00100000:3.0:1782727434.255481:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914546304 00000100:00100000:3.0:1782727434.255485:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914546304 00000100:00100000:3.0:1782727434.255510:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 248 00000100:00100000:3.0:1782727434.255517:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6e0fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecaf1fda-ff42-4054-9f39-8e142296107b+10:2357:x1869324914546304:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1782727434.255545:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6e0fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecaf1fda-ff42-4054-9f39-8e142296107b+10:2357:x1869324914546304:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 28us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727434.255552:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 248 00000100:00080000:3.0:1782727434.255577:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782727434.256352:0:6950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914546560 00000100:00100000:2.0:1782727434.256359:0:6950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914546560 00000100:00100000:2.0:1782727434.256428:0:6950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914546688 00000100:00100000:2.0:1782727434.256431:0:6950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914546688 00000100:00100000:2.0:1782727434.256457:0:6950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 49 00000100:00080000:3.0:1782727434.256534:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782727434.256538:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782727434.256959:0:6950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dffa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d85bc959-008e-4782-8f39-df709fbb4636+5:2357:x1869324914546560:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1782727434.257037:0:6950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dffa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d85bc959-008e-4782-8f39-df709fbb4636+5:2357:x1869324914546560:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 82us (1813us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727434.257045:0:6950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 49 00000100:00100000:2.0:1782727434.257583:0:6950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 50 00000100:00100000:2.0:1782727434.257593:0:6950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c76443b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d85bc959-008e-4782-8f39-df709fbb4636+6:2358:x1869324914546688:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1782727434.258161:0:6950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c76443b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d85bc959-008e-4782-8f39-df709fbb4636+6:2358:x1869324914546688:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 567us (2907us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727434.258170:0:6950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 50 00010000:00010000:0.0:1782727434.752420:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727435.770008:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727436.797550:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727437.817158:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727438.695169:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1782727438.695317:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914546816 00000100:00100000:0.0:1782727438.695331:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914546816 00000100:00100000:0.0:1782727438.695443:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 40 00000100:00100000:0.0:1782727438.695456:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c76442680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d85bc959-008e-4782-8f39-df709fbb4636+7:11621:x1869324914546816:12345-192.168.202.60@tcp:101:rm.0 00010000:00010000:0.0:1782727438.695484:0:5950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727438.695512:0:5950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1200/0x14a47870ee88ced0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1752a87bbfbdf14c expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727438.695597:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0a00/0x14a47870ee88ced7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727438.695616:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0a00/0x14a47870ee88ced7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1782727438.695750:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782727438.695812:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0a00/0x14a47870ee88ced7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727438.696577:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0c00/0x14a47870ee88cede lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727438.696601:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0c00/0x14a47870ee88cede lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727438.696612:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0c00/0x14a47870ee88cede lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727438.696658:0:5950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0a00/0x14a47870ee88ced7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727438.696666:0:5950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0a00/0x14a47870ee88ced7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727438.696672:0:5950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0a00/0x14a47870ee88ced7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727438.696678:0:5950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c7a3e0a00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:0.0:1782727438.696682:0:5950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0a00/0x14a47870ee88ced7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727438.696689:0:5950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0a00/0x14a47870ee88ced7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727438.696702:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921c5fdb5a00) 00010000:00010000:0.0:1782727438.696705:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782727438.696710:0:5950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0a00/0x14a47870ee88ced7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727438.696748:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0a00/0x14a47870ee88ced7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727438.696764:0:5950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0c00/0x14a47870ee88cede lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727438.696768:0:5950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0c00/0x14a47870ee88cede lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727438.696773:0:5950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0c00/0x14a47870ee88cede lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727438.696777:0:5950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c7a3e0c00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:0.0:1782727438.696780:0:5950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0c00/0x14a47870ee88cede lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727438.696785:0:5950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0c00/0x14a47870ee88cede lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727438.696792:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfd1ea4b6 (ffff921c58b4cb00) 00010000:00010000:0.0:1782727438.696794:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782727438.696797:0:5950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0c00/0x14a47870ee88cede lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727438.696802:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0c00/0x14a47870ee88cede lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727438.696849:0:5950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1200/0x14a47870ee88ced0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf14c expref: 8 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727438.696869:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921c5fdb5a00) 00010000:00010000:0.0:1782727438.696872:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782727438.696876:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1200/0x14a47870ee88ced0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf14c expref: 8 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727438.697229:0:5950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c7a3e1200, rc 0) 00000100:00100000:0.0:1782727438.697313:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c76442680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d85bc959-008e-4782-8f39-df709fbb4636+7:11621:x1869324914546816:12345-192.168.202.60@tcp:101:rm.0 Request processed in 1859us (2160us total) trans 0 rc 301/301 00000100:00100000:0.0:1782727438.697322:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 40 00010000:00010000:1.0:1782727438.844813:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727439.033414:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e1eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869324939749120:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782727439.033496:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727439.033581:0:6952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939749120 00000100:00100000:0.0:1782727439.033589:0:6952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939749120 00000100:00100000:0.0:1782727439.033645:0:6952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1782727439.033654:0:6952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e1ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1869324939749120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782727439.033686:0:6952:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1782727439.033728:0:6952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e1ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1869324939749120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727439.033736:0:6952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1782727439.033814:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e1eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869324939749120:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782727439.034350:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782727439.038879:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7df60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869324939749248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782727439.039023:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727439.039114:0:6952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939749248 00000100:00100000:2.0:1782727439.039127:0:6952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939749248 00000100:00100000:2.0:1782727439.039219:0:6952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1782727439.039248:0:6952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c76440e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324939749248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782727439.039292:0:6952:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1782727439.039394:0:6952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c76440e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324939749248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 148us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727439.039474:0:6952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:3.0:1782727439.039532:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782727439.039546:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7df60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869324939749248:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782727439.039991:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782727439.043349:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7d6e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3442:1869324939749504:0@lo:400:kworker.0 00000100:00100000:3.0:1782727439.043447:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727439.043508:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782727439.043515:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7d6e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3442:1869324939749632:0@lo:400:kworker.0 00000100:00100000:3.0:1782727439.043542:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727439.043579:0:12227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939749504 00000100:00100000:3.0:1782727439.043588:0:12227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939749504 00000100:00100000:3.0:1782727439.043634:0:12227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939749632 00000100:00100000:3.0:1782727439.043638:0:12227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939749632 00000100:00100000:3.0:1782727439.043679:0:12227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1782727439.043689:0:12227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c76443100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1869324939749504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727439.043745:0:12227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c76443100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1869324939749504:12345-0@lo:400:kworker.0 Request processed in 58us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727439.043753:0:12227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1782727439.043771:0:12227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1782727439.043778:0:12227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dfc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1869324939749632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727439.043805:0:12227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dfc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1869324939749632:12345-0@lo:400:kworker.0 Request processed in 28us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727439.043811:0:12227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:3.0:1782727439.043831:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782727439.043872:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7d6e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3442:1869324939749632:0@lo:400:kworker.0 00000100:00100000:3.0:1782727439.043911:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7d6e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3442:1869324939749504:0@lo:400:kworker.0 00000100:00100000:2.0:1782727439.047075:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7d6e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3444:1869324939749760:0@lo:400:kworker.0 00000100:00100000:2.0:1782727439.047152:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727439.047352:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7d6e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c71e9f0f-6441-4b9b-bc96-153ab9250801:3444:1869324939749376:0@lo:400:kworker.0 00000100:00100000:2.0:1782727439.047510:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727439.047707:0:12227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939749760 00000100:00100000:3.0:1782727439.047716:0:12227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939749760 00000100:00100000:3.0:1782727439.047789:0:12227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1782727439.047800:0:12227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7df60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1869324939749760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727439.047860:0:12227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7df60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1869324939749760:12345-0@lo:400:kworker.0 Request processed in 62us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727439.047909:0:12227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:2.0:1782727439.049618:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782727439.049680:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7d6e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3444:1869324939749760:0@lo:400:kworker.0 00000100:00100000:0.0:1782727439.054160:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939749376 00000100:00100000:0.0:1782727439.054251:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939749376 00000100:00100000:0.0:1782727439.054403:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1782727439.054415:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6e0ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:3444:x1869324939749376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727439.054613:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6e0ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:3444:x1869324939749376:12345-0@lo:400:kworker.0 Request processed in 201us (7101us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727439.054621:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1782727439.060957:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7d6e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c71e9f0f-6441-4b9b-bc96-153ab9250801:3444:1869324939749376:0@lo:400:kworker.0 00000100:00100000:3.0:1782727439.363265:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1782727439.363315:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1782727439.363362:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1782727439.363398:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1782727439.363580:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914547072 00000100:00100000:1.0:1782727439.363590:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914547072 00000100:00100000:1.0:1782727439.363650:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 125 00000100:00100000:1.0:1782727439.363661:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e031500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d85bc959-008e-4782-8f39-df709fbb4636+7:2357:x1869324914547072:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1782727439.363740:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e031500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d85bc959-008e-4782-8f39-df709fbb4636+7:2357:x1869324914547072:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 80us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727439.363747:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 125 00000100:00100000:0.0:1782727439.364319:0:6950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914547200 00000100:00100000:0.0:1782727439.364325:0:6950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914547200 00000100:00100000:0.0:1782727439.364378:0:6950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914547328 00000100:00100000:0.0:1782727439.364381:0:6950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914547328 00000100:00100000:0.0:1782727439.364402:0:6950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 51 00000100:00100000:0.0:1782727439.364410:0:6950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dfc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d85bc959-008e-4782-8f39-df709fbb4636+5:2357:x1869324914547200:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1782727439.364453:0:6950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dfc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d85bc959-008e-4782-8f39-df709fbb4636+5:2357:x1869324914547200:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 43us (1137us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727439.364472:0:6950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 51 00000100:00100000:0.0:1782727439.364487:0:6950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 52 00000100:00100000:0.0:1782727439.364493:0:6950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dfced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d85bc959-008e-4782-8f39-df709fbb4636+6:2357:x1869324914547328:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1782727439.364519:0:6950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dfced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d85bc959-008e-4782-8f39-df709fbb4636+6:2357:x1869324914547328:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 26us (1120us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727439.364525:0:6950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 52 00000100:00100000:2.0:1782727439.364779:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914546944 00000100:00100000:2.0:1782727439.364784:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914546944 00000100:00100000:2.0:1782727439.364822:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 250 00000100:00100000:2.0:1782727439.364830:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6e0ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecaf1fda-ff42-4054-9f39-8e142296107b+10:2357:x1869324914546944:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1782727439.364863:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6e0ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecaf1fda-ff42-4054-9f39-8e142296107b+10:2357:x1869324914546944:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 34us (1612us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727439.364871:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 250 00000100:00080000:1.0:1782727439.365174:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782727439.365178:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782727439.865243:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727440.889111:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782727441.480153:0:12607:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 118c: Fsync blocks on EROFS until dirty pages are flushed ==================================================================== 06:03:58 (1782727438) 00010000:00010000:1.0:1782727441.916406:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727442.043213:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1782727442.045325:0:12227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914547584 00000100:00100000:3.0:1782727442.045342:0:12227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914547584 00000100:00100000:3.0:1782727442.045524:0:12227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 41 00000100:00100000:3.0:1782727442.045537:0:12227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7d6e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d85bc959-008e-4782-8f39-df709fbb4636+7:11870:x1869324914547584:12345-192.168.202.60@tcp:101:lfs.0 00000100:00080000:1.0:1782727442.045548:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782727442.045559:0:12227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727442.045564:0:12227:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1782727442.045590:0:12227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c4151d800/0x14a47870ee88cec9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf145 expref: 7 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727442.046014:0:12227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921c5fdb5a00) 00010000:00010000:3.0:1782727442.046025:0:12227:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782727442.046042:0:12227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c40030600/0x14a47870ee88cee5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1752a87bbfbdf153 expref: -99 pid: 12227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727442.046148:0:12227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff921c40031a00/0x14a47870ee88ceec lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727442.046158:0:12227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c40031a00/0x14a47870ee88ceec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727442.046166:0:12227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c40031a00/0x14a47870ee88ceec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727442.046226:0:12227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff921c40030800/0x14a47870ee88cef3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727442.046233:0:12227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c40030800/0x14a47870ee88cef3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727442.046241:0:12227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c40030800/0x14a47870ee88cef3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727442.047368:0:12227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921c40031000/0x14a47870ee88cefa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727442.047384:0:12227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c40031000/0x14a47870ee88cefa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727442.047392:0:12227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c40031000/0x14a47870ee88cefa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782727442.047402:0:12227:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5:0x0]: returning size 0 00010000:00010000:3.0:1782727442.047427:0:12227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff921c40031a00/0x14a47870ee88ceec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727442.047434:0:12227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921c40031a00/0x14a47870ee88ceec lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727442.047440:0:12227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921c40031a00/0x14a47870ee88ceec lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727442.047444:0:12227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c40031a00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1782727442.047447:0:12227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c40031a00/0x14a47870ee88ceec lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727442.047461:0:12227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c40031a00/0x14a47870ee88ceec lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727442.047470:0:12227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921c5fdb5700) 00010000:00010000:3.0:1782727442.047472:0:12227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782727442.047475:0:12227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921c40031a00/0x14a47870ee88ceec lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727442.047479:0:12227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c40031a00/0x14a47870ee88ceec lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782727442.047490:0:12227:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d56a9be9 reply state 00000000474d79f4 transno 4294967314 ns: mdt-lustre-MDT0000_UUID lock: ffff921c40030800/0x14a47870ee88cef3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727442.047497:0:12227:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782727442.047522:0:12227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c40030600/0x14a47870ee88cee5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf153 expref: 9 pid: 12227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727442.047536:0:12227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921c40031000/0x14a47870ee88cefa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf153 expref: 8 pid: 12227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727442.047541:0:12227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff921c5fdb5900) 00010000:00010000:3.0:1782727442.047543:0:12227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782727442.047544:0:12227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c40031000, rc 0) 00000100:00100000:3.0:1782727442.047608:0:12227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7d6e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d85bc959-008e-4782-8f39-df709fbb4636+9:11870:x1869324914547584:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 2074us (4467us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1782727442.047616:0:12227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 41 00010000:00010000:1.0:1782727442.049263:0:3429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff921c40030800/0x14a47870ee88cef3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727442.049280:0:3429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921c40030800/0x14a47870ee88cef3 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727442.049287:0:3429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921c40030800/0x14a47870ee88cef3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727442.049293:0:3429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c40030800 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1782727442.049298:0:3429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c40030800/0x14a47870ee88cef3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727442.049305:0:3429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c40030800/0x14a47870ee88cef3 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727442.049319:0:3429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe701ffcf (ffff921c5fdb5500) 00010000:00010000:1.0:1782727442.049332:0:3429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782727442.049337:0:3429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921c40030800/0x14a47870ee88cef3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727442.049343:0:3429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c40030800/0x14a47870ee88cef3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727442.053348:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1782727442.053506:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914547840 00000100:00100000:3.0:1782727442.053529:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914547840 00000100:00100000:3.0:1782727442.053593:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 42 00000100:00100000:3.0:1782727442.053603:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7d6e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d85bc959-008e-4782-8f39-df709fbb4636+8:11870:x1869324914547840:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:3.0:1782727442.053628:0:5948:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727442.053649:0:5948:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c40030400/0x14a47870ee88cf08 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1752a87bbfbdf15a expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727442.053758:0:5948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff921c40030a00/0x14a47870ee88cf0f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727442.053773:0:5948:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff921c40031000/0x14a47870ee88cefa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf153 expref: 9 pid: 12227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727442.053783:0:5948:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff921c40030a00/0x14a47870ee88cf0f lrc: 4/0,1 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727442.053815:0:5948:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff921c40031000/0x14a47870ee88cefa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf153 expref: 9 pid: 12227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727442.053828:0:5948:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff921c40031000/0x14a47870ee88cefa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf153 expref: 9 pid: 12227 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727442.053841:0:5948:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7dfcdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5948:1869324939749888:192.168.202.60@tcp:104: 00000100:00100000:3.0:1782727442.053978:0:5948:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c7d6c1300 going to sleep for 11 seconds 00000100:00100000:2.0:1782727442.058442:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1782727442.058531:0:5934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914547968 00000100:00100000:1.0:1782727442.058539:0:5934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914547968 00010000:00010000:1.0:1782727442.058576:0:5934:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff921c40031000/0x14a47870ee88cefa lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf153 expref: 10 pid: 12227 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727442.058627:0:5934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 30 00000100:00100000:1.0:1782727442.058637:0:5934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7df62300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d85bc959-008e-4782-8f39-df709fbb4636+10:2357:x1869324914547968:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782727442.058652:0:5934:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782727442.058659:0:5934:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff921c40031000/0x14a47870ee88cefa lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf153 expref: 10 pid: 12227 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727442.058671:0:5934:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff921c40031000/0x14a47870ee88cefa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf153 expref: 10 pid: 12227 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727442.058692:0:5934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff921c5fdb5900) 00010000:00010000:1.0:1782727442.058707:0:5934:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff921c40030a00/0x14a47870ee88cf0f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727442.058717:0:5934:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff921c40030a00/0x14a47870ee88cf0f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727442.058725:0:5934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c40030a00/0x14a47870ee88cf0f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727442.058755:0:5934:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782727442.058814:0:5934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7df62300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d85bc959-008e-4782-8f39-df709fbb4636+10:2357:x1869324914547968:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 178us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727442.058823:0:5934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 30 00010000:00010000:3.0:1782727442.060510:0:5948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c40031000/0x14a47870ee88cefa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf153 expref: 9 pid: 12227 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727442.060535:0:5948:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7dfcdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5948:1869324939749888:192.168.202.60@tcp:104: 00010000:00010000:3.0:1782727442.060575:0:5948:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff921c40030a00/0x14a47870ee88cf0f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727442.060803:0:5948:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff921c40030a00/0x14a47870ee88cf0f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727442.060821:0:5948:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c40030a00/0x14a47870ee88cf0f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782727442.061164:0:5948:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5:0x0]: returning size 0 00000004:00080000:2.0:1782727442.061498:0:5948:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00000004:00080000:2.0:1782727442.061509:0:5948:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:2.0:1782727442.061678:0:5948:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff921c40030a00/0x14a47870ee88cf0f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727442.061687:0:5948:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921c40030a00/0x14a47870ee88cf0f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727442.061693:0:5948:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921c40030a00/0x14a47870ee88cf0f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727442.061769:0:5948:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c40030a00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1782727442.061774:0:5948:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c40030a00/0x14a47870ee88cf0f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727442.061782:0:5948:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c40030a00/0x14a47870ee88cf0f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727442.061797:0:5948:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff921c5fdb5900) 00010000:00010000:2.0:1782727442.061800:0:5948:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782727442.061805:0:5948:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921c40030a00/0x14a47870ee88cf0f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727442.061811:0:5948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c40030a00/0x14a47870ee88cf0f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727442.062198:0:5948:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921c40030400/0x14a47870ee88cf08 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf15a expref: 9 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727442.062219:0:5948:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921c5fdb5a00) 00010000:00010000:2.0:1782727442.062221:0:5948:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782727442.062226:0:5948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c40030400/0x14a47870ee88cf08 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf15a expref: 9 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727442.062239:0:5948:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c40030400, rc 0) 00000100:00100000:2.0:1782727442.062361:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7d6e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d85bc959-008e-4782-8f39-df709fbb4636+8:11870:x1869324914547840:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 8758us (9021us total) trans 4294967315 rc 301/301 00000100:00100000:2.0:1782727442.062381:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 42 00000100:00100000:2.0:1782727442.066018:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1782727442.066165:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914548224 00000100:00100000:0.0:1782727442.066175:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914548224 00000100:00100000:0.0:1782727442.066234:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 8 00000100:00100000:0.0:1782727442.066244:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7df60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d85bc959-008e-4782-8f39-df709fbb4636+8:11870:x1869324914548224:12345-192.168.202.60@tcp:35:lfs.0 00000100:00100000:0.0:1782727442.066721:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7df60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d85bc959-008e-4782-8f39-df709fbb4636+9:11870:x1869324914548224:12345-192.168.202.60@tcp:35:lfs.0 Request processed in 477us (711us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1782727442.066743:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 8 00000100:00100000:0.0:1782727442.070834:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1782727442.071006:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914548352 00000100:00100000:3.0:1782727442.071017:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914548352 00000100:00100000:3.0:1782727442.071081:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 43 00000100:00100000:3.0:1782727442.071092:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e1eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d85bc959-008e-4782-8f39-df709fbb4636+9:11870:x1869324914548352:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:3.0:1782727442.071126:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727442.071148:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c40031000/0x14a47870ee88cf1d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1752a87bbfbdf161 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727442.071205:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c40031000/0x14a47870ee88cf1d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf161 expref: 10 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727442.071219:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921c40031000/0x14a47870ee88cf1d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf161 expref: 10 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727442.071237:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff921c5fdb5700) 00010000:00010000:3.0:1782727442.071241:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782727442.071244:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c40031000, rc 0) 00000100:00100000:3.0:1782727442.071357:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e1eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d85bc959-008e-4782-8f39-df709fbb4636+10:11870:x1869324914548352:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 266us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727442.071375:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 43 00000100:00100000:1.0:1782727442.083104:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1782727442.093671:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914548608 00000100:00100000:0.0:1782727442.093689:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914548608 00000100:00100000:0.0:1782727442.094533:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 9 00000100:00100000:0.0:1782727442.094548:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7d6e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d85bc959-008e-4782-8f39-df709fbb4636+10:11870:x1869324914548608:12345-192.168.202.60@tcp:35:lfs.0 00000100:00100000:0.0:1782727442.095019:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7d6e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d85bc959-008e-4782-8f39-df709fbb4636+11:11870:x1869324914548608:12345-192.168.202.60@tcp:35:lfs.0 Request processed in 475us (11924us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1782727442.099534:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 9 00000100:00100000:2.0:1782727442.121735:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1782727442.121847:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914548736 00000100:00100000:0.0:1782727442.121857:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914548736 00000100:00100000:0.0:1782727442.121995:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 44 00000100:00100000:0.0:1782727442.122007:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7df63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d85bc959-008e-4782-8f39-df709fbb4636+11:11871:x1869324914548736:12345-192.168.202.60@tcp:101:dd.0 00010000:00010000:0.0:1782727442.122032:0:5950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727442.122055:0:5950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1800/0x14a47870ee88cf24 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1752a87bbfbdf168 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727442.122127:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0e00/0x14a47870ee88cf2b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727442.122141:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0e00/0x14a47870ee88cf2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727442.122152:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0e00/0x14a47870ee88cf2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782727442.122201:0:5950:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1782727442.122222:0:5950:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782727442.122248:0:5950:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0e00/0x14a47870ee88cf2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727442.122274:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1800/0x14a47870ee88cf24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf168 expref: 13 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727442.122295:0:5950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0e00/0x14a47870ee88cf2b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf168 expref: 12 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727442.122304:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921c58b4cb00) 00010000:00010000:0.0:1782727442.122307:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782727442.122311:0:5950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c7a3e0e00, rc 0) 00000100:00100000:0.0:1782727442.122366:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7df63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d85bc959-008e-4782-8f39-df709fbb4636+12:11871:x1869324914548736:12345-192.168.202.60@tcp:101:dd.0 Request processed in 361us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727442.122373:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 44 00000100:00100000:1.0:1782727442.131217:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1782727442.131305:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914548992 00000100:00100000:3.0:1782727442.131316:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914548992 00000100:00100000:3.0:1782727442.131376:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 45 00000100:00100000:3.0:1782727442.131388:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7d6e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d85bc959-008e-4782-8f39-df709fbb4636+12:11871:x1869324914548992:12345-192.168.202.60@tcp:101:dd.0 00010000:00010000:3.0:1782727442.131425:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727442.131428:0:5949:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1782727442.131455:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0e00/0x14a47870ee88cf2b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf168 expref: 12 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727442.131476:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921c58b4cb00) 00010000:00010000:3.0:1782727442.131487:0:5949:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782727442.131604:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c40030600/0x14a47870ee88cf32 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1752a87bbfbdf16f expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727442.131733:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff921c40031a00/0x14a47870ee88cf39 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727442.131746:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c40031a00/0x14a47870ee88cf39 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727442.131756:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c40031a00/0x14a47870ee88cf39 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727442.131768:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921c40031800/0x14a47870ee88cf40 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727442.131775:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c40031800/0x14a47870ee88cf40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727442.131782:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c40031800/0x14a47870ee88cf40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727442.131836:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921c40030200/0x14a47870ee88cf47 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727442.131855:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c40030200/0x14a47870ee88cf47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727442.131862:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c40030200/0x14a47870ee88cf47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782727442.131873:0:5949:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5:0x0]: returning size 0 00010000:00010000:2.0:1782727442.133598:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff921c40031a00/0x14a47870ee88cf39 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727442.133614:0:5949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921c40031a00/0x14a47870ee88cf39 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727442.133622:0:5949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921c40031a00/0x14a47870ee88cf39 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727442.133630:0:5949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c40031a00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1782727442.133635:0:5949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c40031a00/0x14a47870ee88cf39 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727442.133643:0:5949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c40031a00/0x14a47870ee88cf39 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727442.133658:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921c5fdb5d00) 00010000:00010000:2.0:1782727442.133672:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782727442.133677:0:5949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921c40031a00/0x14a47870ee88cf39 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727442.133684:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c40031a00/0x14a47870ee88cf39 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727442.133700:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921c40031800/0x14a47870ee88cf40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727442.133706:0:5949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921c40031800/0x14a47870ee88cf40 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727442.133712:0:5949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921c40031800/0x14a47870ee88cf40 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727442.133718:0:5949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c40031800 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1782727442.133720:0:5949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c40031800/0x14a47870ee88cf40 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727442.133726:0:5949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c40031800/0x14a47870ee88cf40 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727442.133734:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe701ffcf (ffff921c5fdb5000) 00010000:00010000:2.0:1782727442.133737:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782727442.133740:0:5949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921c40031800/0x14a47870ee88cf40 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727442.133746:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c40031800/0x14a47870ee88cf40 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727442.133803:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c40030600/0x14a47870ee88cf32 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf16f expref: 14 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727442.133836:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921c40030200/0x14a47870ee88cf47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf16f expref: 13 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727442.133843:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff921c5fdb5700) 00010000:00010000:2.0:1782727442.133846:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782727442.133848:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c40030200, rc 0) 00000100:00100000:2.0:1782727442.133943:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7d6e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d85bc959-008e-4782-8f39-df709fbb4636+13:11871:x1869324914548992:12345-192.168.202.60@tcp:101:dd.0 Request processed in 2556us (2734us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1782727442.133952:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 45 00000100:00100000:1.0:1782727442.141655:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1782727442.142738:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914549120 00000100:00100000:0.0:1782727442.142756:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914549120 00000100:00100000:0.0:1782727442.143261:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 46 00000100:00100000:0.0:1782727442.143274:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e08d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d85bc959-008e-4782-8f39-df709fbb4636+13:11871:x1869324914549120:12345-192.168.202.60@tcp:101:dd.0 00010000:00010000:0.0:1782727442.143298:0:5950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727442.143321:0:5950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1800/0x14a47870ee88cf55 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1752a87bbfbdf176 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727442.144034:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0e00/0x14a47870ee88cf5c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727442.144050:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0e00/0x14a47870ee88cf5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727442.144079:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0e00/0x14a47870ee88cf5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727442.144201:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1800/0x14a47870ee88cf55 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf176 expref: 15 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727442.144223:0:5950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0e00/0x14a47870ee88cf5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf176 expref: 14 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727442.144305:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff921c5fdb5700) 00010000:00010000:0.0:1782727442.144308:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1782727442.144312:0:5950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c7a3e0e00, rc 0) 00000100:00100000:0.0:1782727442.144392:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e08d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d85bc959-008e-4782-8f39-df709fbb4636+14:11871:x1869324914549120:12345-192.168.202.60@tcp:101:dd.0 Request processed in 1120us (2751us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727442.144400:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 46 00000100:00100000:3.0:1782727442.150402:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1782727442.150841:0:12227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914549376 00000100:00100000:0.0:1782727442.150851:0:12227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914549376 00000100:00100000:0.0:1782727442.151132:0:12227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 47 00000100:00100000:0.0:1782727442.151144:0:12227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dfcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d85bc959-008e-4782-8f39-df709fbb4636+14:11871:x1869324914549376:12345-192.168.202.60@tcp:36:dd.0 00010000:00010000:0.0:1782727442.151199:0:12227:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782727442.151222:0:12227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c40030200/0x14a47870ee88cf47 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf16f expref: 14 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727442.151356:0:12227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff921c5fdb5700) 00010000:00010000:0.0:1782727442.151361:0:12227:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782727442.151530:0:12227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1800/0x14a47870ee88cf63 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727442.151556:0:12227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1800/0x14a47870ee88cf63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727442.151567:0:12227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1800/0x14a47870ee88cf63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782727442.151614:0:12227:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000004:00010000:0.0:1782727442.151653:0:12227:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008c0fd0a6 reply state 00000000831f7278 transno 4294967320 ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1800/0x14a47870ee88cf63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727442.151662:0:12227:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782727442.151806:0:12227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dfcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d85bc959-008e-4782-8f39-df709fbb4636+16:11871:x1869324914549376:12345-192.168.202.60@tcp:36:dd.0 Request processed in 663us (1412us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1782727442.151814:0:12227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 47 00000020:00080000:0.0:1782727442.151818:0:12227:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1782727442.155558:0:3428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1800/0x14a47870ee88cf63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727442.155577:0:3428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1800/0x14a47870ee88cf63 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727442.155585:0:3428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1800/0x14a47870ee88cf63 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727442.155591:0:3428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c7a3e1800 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:0.0:1782727442.155596:0:3428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1800/0x14a47870ee88cf63 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727442.155605:0:3428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1800/0x14a47870ee88cf63 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727442.155643:0:3428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff921c5fdb5700) 00010000:00010000:0.0:1782727442.155645:0:3428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782727442.155650:0:3428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1800/0x14a47870ee88cf63 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727442.155656:0:3428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1800/0x14a47870ee88cf63 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727442.159422:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1782727442.159546:0:6950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914549504 00000100:00100000:0.0:1782727442.159556:0:6950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914549504 00000100:00100000:0.0:1782727442.159629:0:6950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 20 00000100:00100000:0.0:1782727442.159639:0:6950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e2aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d85bc959-008e-4782-8f39-df709fbb4636+5:11871:x1869324914549504:12345-192.168.202.60@tcp:101:dd.0 00010000:00010000:0.0:1782727442.159658:0:6950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727442.159675:0:6950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a7398ec5/0x14a47870ee88cf6a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1752a87bbfbdf17d expref: -99 pid: 6950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782727442.159697:0:6950:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782727442.159717:0:6950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=336s v=(0 0) 00010000:00010000:0.0:1782727442.159720:0:6950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782727442.159725:0:6950:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7398ec5/0x14a47870ee88cf6a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf17d expref: 6 pid: 6950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727442.159737:0:6950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a7398ec5/0x14a47870ee88cf6a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf17d expref: 6 pid: 6950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727442.159746:0:6950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c7a3e1a00, rc 0) 00000100:00100000:0.0:1782727442.159798:0:6950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e2aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d85bc959-008e-4782-8f39-df709fbb4636+6:11871:x1869324914549504:12345-192.168.202.60@tcp:101:dd.0 Request processed in 161us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727442.159808:0:6950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 20 00000100:00080000:1.0:1782727442.159856:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782727442.163778:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1782727442.163911:0:6951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914549632 00000100:00100000:2.0:1782727442.163921:0:6951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914549632 00000100:00100000:2.0:1782727442.164005:0:6951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 21 00000100:00100000:2.0:1782727442.164016:0:6951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e08fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d85bc959-008e-4782-8f39-df709fbb4636+6:11871:x1869324914549632:12345-192.168.202.60@tcp:101:dd.0 00010000:00010000:2.0:1782727442.164035:0:6951:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727442.164056:0:6951:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004abbec9d/0x14a47870ee88cf71 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1752a87bbfbdf184 expref: -99 pid: 6951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782727442.164083:0:6951:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1782727442.164106:0:6951:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=336s v=(0 0) 00010000:00010000:2.0:1782727442.164110:0:6951:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782727442.164118:0:6951:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004abbec9d/0x14a47870ee88cf71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf184 expref: 7 pid: 6951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727442.164133:0:6951:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004abbec9d/0x14a47870ee88cf71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf184 expref: 7 pid: 6951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727442.164162:0:6951:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c429d4200, rc 0) 00000100:00100000:2.0:1782727442.164225:0:6951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e08fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d85bc959-008e-4782-8f39-df709fbb4636+7:11871:x1869324914549632:12345-192.168.202.60@tcp:101:dd.0 Request processed in 211us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727442.164233:0:6951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 21 00000100:00080000:1.0:1782727442.164306:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782727442.169751:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1782727442.169810:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1782727442.170265:0:6955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914549760 00000100:00100000:1.0:1782727442.170275:0:6955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914549760 00002000:00010000:1.0:1782727442.170315:0:6955:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:1.0:1782727442.170320:0:6955:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff921c7dfcea00 with x1869324914549760 ext(0->18446744073709551615) 00002000:00010000:1.0:1782727442.170332:0:6955:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff921c7dfcea00. 00000100:00100000:1.0:1782727442.170363:0:6955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914549888 00000100:00100000:1.0:1782727442.170366:0:6955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914549888 00002000:00010000:1.0:1782727442.170381:0:6955:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/4 (0->18446744073709551615) 00002000:00100000:1.0:1782727442.170384:0:6955:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff921c7dfcfb80 with x1869324914549888 ext(0->18446744073709551615) 00002000:00010000:1.0:1782727442.170400:0:6955:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff921c7dfcfb80. 00000100:00100000:1.0:1782727442.170414:0:6955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 0 00000100:00100000:1.0:1782727442.170424:0:6955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dfcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d85bc959-008e-4782-8f39-df709fbb4636+6:2355:x1869324914549760:12345-192.168.202.60@tcp:10:dd.0 00002000:00010000:1.0:1782727442.170779:0:6955:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1782727442.170783:0:6955:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1782727441 00002000:00010000:1.0:1782727442.170785:0:6955:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1782727442.170787:0:6955:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1782727441 00002000:00010000:1.0:1782727442.170804:0:6955:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1782727442.170860:0:6955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dfcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d85bc959-008e-4782-8f39-df709fbb4636+7:2355:x1869324914549760:12345-192.168.202.60@tcp:10:dd.0 Request processed in 437us (1120us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1782727442.170868:0:6955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 0 00002000:00010000:1.0:1782727442.170871:0:6955:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:1.0:1782727442.170875:0:6955:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff921c7dfcea00 with x1869324914549760 ext(0->18446744073709551615) 00002000:00010000:1.0:1782727442.170879:0:6955:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff921c7dfcea00. 00000100:00100000:1.0:1782727442.170925:0:6955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 1 00000100:00100000:1.0:1782727442.170932:0:6955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dfcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d85bc959-008e-4782-8f39-df709fbb4636+7:2355:x1869324914549888:12345-192.168.202.60@tcp:10:dd.0 00002000:00010000:1.0:1782727442.171082:0:6955:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1782727442.171085:0:6955:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1782727441 00002000:00010000:1.0:1782727442.171086:0:6955:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1782727442.171088:0:6955:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1782727441 00002000:00010000:1.0:1782727442.171089:0:6955:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1782727442.171104:0:6955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dfcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d85bc959-008e-4782-8f39-df709fbb4636+8:2355:x1869324914549888:12345-192.168.202.60@tcp:10:dd.0 Request processed in 174us (1295us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1782727442.171108:0:6955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 1 00002000:00010000:1.0:1782727442.171110:0:6955:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/4 (0->18446744073709551615) 00002000:00100000:1.0:1782727442.171112:0:6955:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff921c7dfcfb80 with x1869324914549888 ext(0->18446744073709551615) 00002000:00010000:1.0:1782727442.171115:0:6955:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff921c7dfcfb80. 00000100:00100000:0.0:1782727442.200643:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1782727442.200862:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914550144 00000100:00100000:3.0:1782727442.200872:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914550144 00000100:00100000:3.0:1782727442.200967:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 10 00000100:00100000:3.0:1782727442.200979:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c66fd2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d85bc959-008e-4782-8f39-df709fbb4636+15:11871:x1869324914550144:12345-192.168.202.60@tcp:35:dd.0 00000100:00100000:3.0:1782727442.201299:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c66fd2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d85bc959-008e-4782-8f39-df709fbb4636+16:11871:x1869324914550144:12345-192.168.202.60@tcp:35:dd.0 Request processed in 321us (664us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1782727442.201308:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 10 00000100:00100000:1.0:1782727442.226783:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1782727442.227055:0:6955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914550272 00000100:00100000:3.0:1782727442.227066:0:6955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914550272 00002000:00100000:2.0:1782727442.227206:0:6955:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->131071) req@ffff921c7e08e300 x1869324914550272/t0(0) o4->d85bc959-008e-4782-8f39-df709fbb4636@192.168.202.60@tcp:313/0 lens 488/0 e 0 to 0 dl 1782727453 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782727442.227218:0:6955:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff921c7e08e300 with x1869324914550272 ext(0->131071) 00002000:00010000:2.0:1782727442.227225:0:6955:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff921c7e08e300 00000100:00100000:2.0:1782727442.227296:0:6955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 2 00000100:00100000:2.0:1782727442.227306:0:6955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e08e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d85bc959-008e-4782-8f39-df709fbb4636+7:2355:x1869324914550272:12345-192.168.202.60@tcp:4:dd.0 00000100:00100000:2.0:1782727442.245621:0:6955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e08e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d85bc959-008e-4782-8f39-df709fbb4636+9:2355:x1869324914550272:12345-192.168.202.60@tcp:4:dd.0 Request processed in 18301us (18834us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1782727442.245638:0:6955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 2 00002000:00100000:2.0:1782727442.245653:0:6955:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->131071) req@ffff921c7e08e300 x1869324914550272/t4294967301(0) o4->d85bc959-008e-4782-8f39-df709fbb4636@192.168.202.60@tcp:313/0 lens 488/448 e 0 to 0 dl 1782727453 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782727442.245665:0:6955:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff921c7e08e300 with x1869324914550272 ext(0->131071) 00002000:00010000:2.0:1782727442.245671:0:6955:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff921c7e08e300 00000100:00100000:1.0:1782727442.272680:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1782727442.272760:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914550400 00000100:00100000:2.0:1782727442.272769:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914550400 00000100:00100000:2.0:1782727442.272823:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 48 00000100:00100000:2.0:1782727442.272834:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e08ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d85bc959-008e-4782-8f39-df709fbb4636+16:11873:x1869324914550400:12345-192.168.202.60@tcp:101:rm.0 00010000:00010000:2.0:1782727442.272859:0:5948:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727442.272908:0:5948:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d4600/0x14a47870ee88cf78 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1752a87bbfbdf18b expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727442.272975:0:5948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d4800/0x14a47870ee88cf7f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727442.273001:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d4800/0x14a47870ee88cf7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727442.273013:0:5948:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d4800/0x14a47870ee88cf7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782727442.273062:0:5948:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1782727442.273066:0:5948:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782727442.273086:0:5948:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d4800/0x14a47870ee88cf7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727442.273110:0:5948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d4600/0x14a47870ee88cf78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf18b expref: 18 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727442.273129:0:5948:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d4800/0x14a47870ee88cf7f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf18b expref: 17 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727442.273138:0:5948:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921c56fbb800) 00010000:00010000:2.0:1782727442.273141:0:5948:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782727442.273145:0:5948:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c429d4800, rc 0) 00000100:00100000:2.0:1782727442.273210:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e08ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d85bc959-008e-4782-8f39-df709fbb4636+17:11873:x1869324914550400:12345-192.168.202.60@tcp:101:rm.0 Request processed in 377us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727442.273218:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 48 00000100:00100000:3.0:1782727442.280184:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1782727442.280398:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914550528 00000100:00100000:2.0:1782727442.280423:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914550528 00000100:00100000:2.0:1782727442.280487:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 49 00000100:00100000:2.0:1782727442.280497:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dfcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d85bc959-008e-4782-8f39-df709fbb4636+17:11873:x1869324914550528:12345-192.168.202.60@tcp:101:rm.0 00010000:00010000:2.0:1782727442.280518:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727442.280537:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d4600/0x14a47870ee88cf86 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1752a87bbfbdf192 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727442.280591:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d5600/0x14a47870ee88cf8d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727442.280602:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d5600/0x14a47870ee88cf8d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727442.280609:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d5600/0x14a47870ee88cf8d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727442.280618:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d4a00/0x14a47870ee88cf94 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727442.280622:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d4a00/0x14a47870ee88cf94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727442.280625:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d4a00/0x14a47870ee88cf94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727442.280702:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7df49a00/0x14a47870ee88cf9b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727442.280708:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c7df49a00/0x14a47870ee88cf9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727442.280713:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c7df49a00/0x14a47870ee88cf9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782727442.280746:0:5949:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5:0x0]: returning size 131072 00000004:00200000:2.0:1782727442.280750:0:5949:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782727442.280763:0:5949:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff921c7df49a00/0x14a47870ee88cf9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727442.280771:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c7df49a00/0x14a47870ee88cf9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727442.280777:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d5600/0x14a47870ee88cf8d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727442.280781:0:5949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d5600/0x14a47870ee88cf8d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727442.280784:0:5949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d5600/0x14a47870ee88cf8d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727442.280788:0:5949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c429d5600 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1782727442.280791:0:5949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d5600/0x14a47870ee88cf8d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727442.280795:0:5949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d5600/0x14a47870ee88cf8d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727442.280804:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921c56fbb800) 00010000:00010000:2.0:1782727442.280806:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782727442.280808:0:5949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d5600/0x14a47870ee88cf8d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727442.280813:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d5600/0x14a47870ee88cf8d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727442.280829:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d4a00/0x14a47870ee88cf94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727442.280833:0:5949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d4a00/0x14a47870ee88cf94 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727442.280836:0:5949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d4a00/0x14a47870ee88cf94 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727442.280839:0:5949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c429d4a00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1782727442.280841:0:5949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d4a00/0x14a47870ee88cf94 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727442.280844:0:5949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d4a00/0x14a47870ee88cf94 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727442.280847:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe701ffcf (ffff921c56fbba00) 00010000:00010000:2.0:1782727442.280849:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782727442.280850:0:5949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d4a00/0x14a47870ee88cf94 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727442.280853:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d4a00/0x14a47870ee88cf94 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727442.280874:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d4600/0x14a47870ee88cf86 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf192 expref: 19 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727442.280949:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7df49a00/0x14a47870ee88cf9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf192 expref: 18 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727442.280976:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff921c5fdb5700) 00010000:00010000:2.0:1782727442.280979:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782727442.280982:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c7df49a00, rc 0) 00000100:00100000:2.0:1782727442.281058:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dfcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d85bc959-008e-4782-8f39-df709fbb4636+18:11873:x1869324914550528:12345-192.168.202.60@tcp:101:rm.0 Request processed in 561us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727442.281065:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 49 00000100:00100000:3.0:1782727442.299806:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1782727442.299919:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914550784 00000100:00100000:0.0:1782727442.299928:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914550784 00000100:00100000:0.0:1782727442.300003:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 50 00000100:00100000:0.0:1782727442.300017:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6e380e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d85bc959-008e-4782-8f39-df709fbb4636+18:11873:x1869324914550784:12345-192.168.202.60@tcp:36:rm.0 00010000:00010000:0.0:1782727442.300074:0:5950:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1782727442.300103:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c7df49a00/0x14a47870ee88cf9b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf192 expref: 18 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727442.300128:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0e00/0x14a47870ee88cf5c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf176 expref: 17 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727442.300141:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c40031000/0x14a47870ee88cf1d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf161 expref: 16 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727442.300152:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff921c5fdb5700) 00010000:00010000:0.0:1782727442.300170:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c429d4800/0x14a47870ee88cf7f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf18b expref: 15 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727442.300181:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921c56fbb800) 00010000:00010000:0.0:1782727442.300188:0:5950:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782727442.300214:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1800/0x14a47870ee88cfa2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727442.300426:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1800/0x14a47870ee88cfa2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727442.300455:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1800/0x14a47870ee88cfa2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727442.300470:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0a00/0x14a47870ee88cfa9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727442.300477:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0a00/0x14a47870ee88cfa9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727442.300483:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0a00/0x14a47870ee88cfa9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727442.303377:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0c00/0x14a47870ee88cfb0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727442.303401:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0c00/0x14a47870ee88cfb0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727442.303413:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0c00/0x14a47870ee88cfb0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782727442.303647:0:5950:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:0.0:1782727442.303658:0:5950:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 337061773801ns, next at 338061771701ns, rc = 0 00000040:00080000:0.0:1782727442.303680:0:5950:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:0.0:1782727442.303687:0:5950:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 337061802814ns, next at 338061802103ns, rc = 0 00010000:00010000:0.0:1782727442.303734:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1200/0x14a47870ee88cfb7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727442.303745:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1200/0x14a47870ee88cfb7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727442.303770:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1200/0x14a47870ee88cfb7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727442.303778:0:5950:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1200/0x14a47870ee88cfb7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727442.303783:0:5950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1200/0x14a47870ee88cfb7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727442.303790:0:5950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1200/0x14a47870ee88cfb7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727442.303871:0:5950:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782727442.303914:0:5950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0c00/0x14a47870ee88cfb0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727442.303922:0:5950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0c00/0x14a47870ee88cfb0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727442.303928:0:5950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0c00/0x14a47870ee88cfb0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727442.303934:0:5950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c7a3e0c00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:0.0:1782727442.303939:0:5950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0c00/0x14a47870ee88cfb0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727442.303946:0:5950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0c00/0x14a47870ee88cfb0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727442.303969:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff921c58b4c100) 00010000:00010000:0.0:1782727442.303972:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782727442.303983:0:5950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0c00/0x14a47870ee88cfb0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727442.303989:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0c00/0x14a47870ee88cfb0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727442.304007:0:5950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1800/0x14a47870ee88cfa2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727442.304013:0:5950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1800/0x14a47870ee88cfa2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727442.304018:0:5950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1800/0x14a47870ee88cfa2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727442.304023:0:5950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c7a3e1800 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:0.0:1782727442.304026:0:5950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1800/0x14a47870ee88cfa2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727442.304031:0:5950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1800/0x14a47870ee88cfa2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727442.304039:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921c58b4c300) 00010000:00010000:0.0:1782727442.304041:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782727442.304043:0:5950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1800/0x14a47870ee88cfa2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727442.304050:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1800/0x14a47870ee88cfa2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782727442.304066:0:5950:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007cc329d4 reply state 000000006bf67a6a transno 4294967322 ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0a00/0x14a47870ee88cfa9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727442.304087:0:5950:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782727442.304182:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6e380e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d85bc959-008e-4782-8f39-df709fbb4636+16:11873:x1869324914550784:12345-192.168.202.60@tcp:36:rm.0 Request processed in 4164us (4382us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1782727442.304192:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 50 00010000:00010000:2.0:1782727442.304567:0:5937:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782727442.304574:0:5937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1200/0x14a47870ee88cfb7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727442.304581:0:5937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c7a3e1200 already unused, calling callback (ffffffffc0c98cf0) 00010000:00010000:2.0:1782727442.304584:0:5937:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1200/0x14a47870ee88cfb7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727442.304590:0:5937:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1200/0x14a47870ee88cfb7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727442.304599:0:5937:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff921c58b4c100) 00010000:00010000:2.0:1782727442.304601:0:5937:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1782727442.304604:0:5937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1200/0x14a47870ee88cfb7 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727442.304609:0:5937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1200/0x14a47870ee88cfb7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727442.304623:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727442.304624:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727442.304626:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727442.305818:0:3429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0a00/0x14a47870ee88cfa9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727442.305832:0:3429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0a00/0x14a47870ee88cfa9 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727442.305851:0:3429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0a00/0x14a47870ee88cfa9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727442.305857:0:3429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c7a3e0a00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1782727442.305861:0:3429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0a00/0x14a47870ee88cfa9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727442.305868:0:3429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0a00/0x14a47870ee88cfa9 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727442.306041:0:3429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe701ffcf (ffff921c58b4ca00) 00010000:00010000:1.0:1782727442.306045:0:3429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782727442.306050:0:3429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0a00/0x14a47870ee88cfa9 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727442.306056:0:3429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0a00/0x14a47870ee88cfa9 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727442.937485:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727443.742211:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1782727443.744579:0:12227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914550912 00000100:00100000:3.0:1782727443.744594:0:12227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914550912 00000100:00100000:3.0:1782727443.744671:0:12227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 51 00000100:00100000:3.0:1782727443.744682:0:12227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e1ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d85bc959-008e-4782-8f39-df709fbb4636+15:11915:x1869324914550912:12345-192.168.202.60@tcp:101:multiop.0 00010000:00010000:3.0:1782727443.744707:0:12227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727443.744730:0:12227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c40030a00/0x14a47870ee88cfbe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1752a87bbfbdf199 expref: -99 pid: 12227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727443.744811:0:12227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921c40030400/0x14a47870ee88cfc5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727443.744825:0:12227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c40030400/0x14a47870ee88cfc5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727443.744838:0:12227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c40030400/0x14a47870ee88cfc5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782727443.744908:0:12227:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1782727443.744913:0:12227:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782727443.744932:0:12227:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff921c40030400/0x14a47870ee88cfc5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727443.744965:0:12227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c40030a00/0x14a47870ee88cfbe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf199 expref: 17 pid: 12227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727443.744979:0:12227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921c40030400/0x14a47870ee88cfc5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf199 expref: 16 pid: 12227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727443.744987:0:12227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921c5fdb5600) 00010000:00010000:3.0:1782727443.744990:0:12227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782727443.744994:0:12227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c40030400, rc 0) 00000100:00100000:3.0:1782727443.745063:0:12227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e1ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d85bc959-008e-4782-8f39-df709fbb4636+16:11915:x1869324914550912:12345-192.168.202.60@tcp:101:multiop.0 Request processed in 382us (2860us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727443.745070:0:12227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 51 00000100:00100000:3.0:1782727443.750544:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1782727443.750627:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914551168 00000100:00100000:0.0:1782727443.750635:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914551168 00000100:00100000:0.0:1782727443.750685:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 52 00000100:00100000:0.0:1782727443.750693:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7df60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d85bc959-008e-4782-8f39-df709fbb4636+16:11915:x1869324914551168:12345-192.168.202.60@tcp:101:multiop.0 00010000:00010000:0.0:1782727443.750714:0:5948:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727443.750717:0:5948:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1782727443.750741:0:5948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c40030400/0x14a47870ee88cfc5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf199 expref: 16 pid: 12227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727443.750757:0:5948:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921c5fdb5600) 00010000:00010000:0.0:1782727443.750766:0:5948:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782727443.750780:0:5948:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0e00/0x14a47870ee88cfcc lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1752a87bbfbdf1a0 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727443.750867:0:5948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0c00/0x14a47870ee88cfd3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727443.750877:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0c00/0x14a47870ee88cfd3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727443.750905:0:5948:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0c00/0x14a47870ee88cfd3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727443.750922:0:5948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1800/0x14a47870ee88cfda lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727443.750927:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1800/0x14a47870ee88cfda lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727443.750931:0:5948:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1800/0x14a47870ee88cfda lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782727443.751311:0:5948:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:0.0:1782727443.751428:0:5948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0a00/0x14a47870ee88cfe1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727443.751438:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0a00/0x14a47870ee88cfe1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727443.751446:0:5948:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0a00/0x14a47870ee88cfe1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727443.751472:0:5948:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0c00/0x14a47870ee88cfd3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727443.751476:0:5948:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0c00/0x14a47870ee88cfd3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727443.751481:0:5948:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0c00/0x14a47870ee88cfd3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727443.751487:0:5948:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c7a3e0c00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:0.0:1782727443.751491:0:5948:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0c00/0x14a47870ee88cfd3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727443.751509:0:5948:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0c00/0x14a47870ee88cfd3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727443.751519:0:5948:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921c58b4c600) 00010000:00010000:0.0:1782727443.751521:0:5948:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782727443.751526:0:5948:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0c00/0x14a47870ee88cfd3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727443.751532:0:5948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0c00/0x14a47870ee88cfd3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782727443.751544:0:5948:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b05d230b reply state 0000000001346a70 transno 4294967323 ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1800/0x14a47870ee88cfda lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727443.751552:0:5948:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1782727443.751578:0:5948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0e00/0x14a47870ee88cfcc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf1a0 expref: 18 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727443.751591:0:5948:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0a00/0x14a47870ee88cfe1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf1a0 expref: 17 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727443.751597:0:5948:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff921c58b4c900) 00010000:00010000:0.0:1782727443.751598:0:5948:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782727443.751600:0:5948:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c7a3e0a00, rc 0) 00000100:00100000:0.0:1782727443.751659:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7df60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d85bc959-008e-4782-8f39-df709fbb4636+18:11915:x1869324914551168:12345-192.168.202.60@tcp:101:multiop.0 Request processed in 967us (1126us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1782727443.751665:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 52 00010000:00010000:2.0:1782727443.756444:0:3428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1800/0x14a47870ee88cfda lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727443.756470:0:3428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1800/0x14a47870ee88cfda lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727443.756477:0:3428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1800/0x14a47870ee88cfda lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727443.756484:0:3428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c7a3e1800 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1782727443.756489:0:3428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1800/0x14a47870ee88cfda lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727443.756497:0:3428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1800/0x14a47870ee88cfda lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727443.756513:0:3428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x11a4e1a9 (ffff921c58b4cd00) 00010000:00010000:2.0:1782727443.756516:0:3428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782727443.756520:0:3428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1800/0x14a47870ee88cfda lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727443.756526:0:3428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1800/0x14a47870ee88cfda lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727443.763470:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1782727443.764339:0:6950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914551296 00000100:00100000:0.0:1782727443.764362:0:6950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914551296 00000100:00100000:0.0:1782727443.764450:0:6950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 22 00000100:00100000:0.0:1782727443.764462:0:6950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e08ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d85bc959-008e-4782-8f39-df709fbb4636+9:11915:x1869324914551296:12345-192.168.202.60@tcp:101:multiop.0 00010000:00010000:0.0:1782727443.764489:0:6950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727443.764513:0:6950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3e7f56a/0x14a47870ee88cfef lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1752a87bbfbdf1a7 expref: -99 pid: 6950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782727443.764537:0:6950:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782727443.764557:0:6950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=338s v=(0 0) 00010000:00010000:0.0:1782727443.764561:0:6950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782727443.764571:0:6950:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3e7f56a/0x14a47870ee88cfef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf1a7 expref: 10 pid: 6950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727443.764589:0:6950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d3e7f56a/0x14a47870ee88cfef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf1a7 expref: 10 pid: 6950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727443.764601:0:6950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c7a3e0e00, rc 0) 00000100:00100000:0.0:1782727443.764672:0:6950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e08ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d85bc959-008e-4782-8f39-df709fbb4636+10:11915:x1869324914551296:12345-192.168.202.60@tcp:101:multiop.0 Request processed in 212us (1213us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727443.764680:0:6950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 22 00000100:00100000:3.0:1782727443.775237:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1782727443.775329:0:6956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914551424 00000100:00100000:2.0:1782727443.775341:0:6956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914551424 00002000:00100000:2.0:1782727443.775389:0:6956:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff921c7d6e9880 x1869324914551424/t0(0) o4->d85bc959-008e-4782-8f39-df709fbb4636@192.168.202.60@tcp:314/0 lens 4584/0 e 0 to 0 dl 1782727454 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782727443.775402:0:6956:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff921c7d6e9880 with x1869324914551424 ext(0->4095) 00002000:00010000:2.0:1782727443.775407:0:6956:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff921c7d6e9880 00000100:00100000:2.0:1782727443.775439:0:6956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 3 00000100:00100000:2.0:1782727443.775449:0:6956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7d6e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d85bc959-008e-4782-8f39-df709fbb4636+10:2358:x1869324914551424:12345-192.168.202.60@tcp:4:multiop.0 00000001:00020000:2.0:1782727443.775469:0:6956:0:(tgt_handler.c:2756:tgt_brw_write()) cfs_fail_timeout id 216 sleeping for 1000ms 00010000:00010000:1.0:1782727443.961514:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1782727444.153132:0:7421:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 338911245957ns, next at 339911242888ns, rc = 0 00000100:00100000:0.0:1782727444.153173:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e1ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869324939750016:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782727444.153254:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727444.153299:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e08c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869324939750528:0@lo:400:kworker.0 00000100:00100000:1.0:1782727444.153309:0:6952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939750016 00000100:00100000:1.0:1782727444.153318:0:6952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939750016 00000100:00100000:0.0:1782727444.153324:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727444.153349:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782727444.153368:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e08ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3445:1869324939750400:0@lo:400:kworker.0 00000100:00100000:0.0:1782727444.153394:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727444.153406:0:6952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1782727444.153418:0:6952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e1ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869324939750016:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782727444.153422:0:6951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939750528 00000100:00100000:0.0:1782727444.153427:0:6951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939750528 00002000:00000024:1.0:1782727444.153450:0:6952:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125952 pending 155648 free 3923537920 avail 3692015616 00000100:00100000:0.0:1782727444.153456:0:6951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1782727444.153463:0:6951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e1efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3445:x1869324939750528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727444.153510:0:6952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e1ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3445:x1869324939750016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727444.153520:0:6952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1782727444.153520:0:6951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e1efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3445:x1869324939750528:12345-0@lo:400:kworker.0 Request processed in 55us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727444.153530:0:6951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:1.0:1782727444.153548:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782727444.153565:0:12227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939750400 00000100:00100000:0.0:1782727444.153570:0:12227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939750400 00000100:00100000:0.0:1782727444.153606:0:12227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1782727444.153613:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e1ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869324939750016:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782727444.153616:0:12227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e1ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3445:x1869324939750400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727444.153631:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e08c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869324939750528:0@lo:400:kworker.0 00000100:00100000:0.0:1782727444.153657:0:12227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e1ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3445:x1869324939750400:12345-0@lo:400:kworker.0 Request processed in 42us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727444.153662:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e08ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3445:1869324939750400:0@lo:400:kworker.0 00000100:00100000:0.0:1782727444.153668:0:12227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:1.0:1782727444.153683:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:0.0:1782727444.155352:0:8459:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 338913466133ns, next at 339913463047ns, rc = 0 00000100:00100000:0.0:1782727444.155416:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e1ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869324939750912:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782727444.155472:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727444.155693:0:6952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939750912 00000100:00100000:1.0:1782727444.155701:0:6952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939750912 00000100:00100000:3.0:1782727444.155994:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e08f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c71e9f0f-6441-4b9b-bc96-153ab9250801:3442:1869324939750144:0@lo:400:kworker.0 00000100:00080000:0.0:1782727444.156001:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782727444.156035:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727444.156059:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e08f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3442:1869324939750656:0@lo:400:kworker.0 00000100:00100000:3.0:1782727444.156082:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727444.156100:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1782727444.156106:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e08ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3442:1869324939750272:0@lo:400:kworker.0 00000100:00100000:3.0:1782727444.156126:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727444.156142:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e08df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869324939750784:0@lo:400:kworker.0 00000100:00100000:3.0:1782727444.156166:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727444.156172:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939750144 00000100:00100000:0.0:1782727444.156176:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939750144 00000100:00100000:3.0:1782727444.156200:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939750656 00000100:00100000:0.0:1782727444.156207:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1782727444.156215:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6e0fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:3442:x1869324939750144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727444.156264:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6e0fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:3442:x1869324939750144:12345-0@lo:400:kworker.0 Request processed in 49us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727444.156269:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1782727444.156311:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939750272 00000100:00100000:0.0:1782727444.156314:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939750272 00000100:00100000:0.0:1782727444.156330:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1782727444.156334:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1869324939750272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727444.156356:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1869324939750272:12345-0@lo:400:kworker.0 Request processed in 22us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727444.156360:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1782727444.156377:0:9464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939750784 00000100:00100000:0.0:1782727444.156379:0:9464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939750784 00000100:00100000:0.0:1782727444.156391:0:9464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1782727444.156395:0:9464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3442:x1869324939750784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727444.156412:0:9464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3442:x1869324939750784:12345-0@lo:400:kworker.0 Request processed in 17us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727444.156416:0:9464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1782727444.156629:0:6952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1782727444.156640:0:6952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e1ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324939750912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782727444.156663:0:6952:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1782727444.156705:0:6952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e1ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324939750912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (1232us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727444.156712:0:6952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1782727444.156754:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e1ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869324939750912:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782727444.156795:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e08ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3442:1869324939750272:0@lo:400:kworker.0 00000100:00100000:0.0:1782727444.156805:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e08df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869324939750784:0@lo:400:kworker.0 00000100:00100000:0.0:1782727444.156813:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e08f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c71e9f0f-6441-4b9b-bc96-153ab9250801:3442:1869324939750144:0@lo:400:kworker.0 00000100:00100000:3.0:1782727444.157095:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939750656 00000100:00080000:0.0:1782727444.157145:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782727444.157187:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1782727444.157195:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1869324939750656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727444.157252:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1869324939750656:12345-0@lo:400:kworker.0 Request processed in 58us (1169us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727444.157259:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1782727444.157292:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e08f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3442:1869324939750656:0@lo:400:kworker.0 00000100:00100000:1.0:1782727444.489529:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1782727444.489578:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1782727444.489619:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1782727444.489656:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1782727444.489689:0:6949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914551808 00000100:00100000:1.0:1782727444.489699:0:6949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914551808 00000100:00100000:2.0:1782727444.489703:0:6951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914551936 00000100:00100000:2.0:1782727444.489706:0:6951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914551936 00000100:00100000:3.0:1782727444.489761:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914551680 00000100:00100000:3.0:1782727444.489765:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914551680 00000100:00100000:0.0:1782727444.489833:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914551552 00000100:00100000:0.0:1782727444.489838:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914551552 00000100:00100000:0.0:1782727444.489914:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 252 00000100:00100000:0.0:1782727444.489925:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6e0ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecaf1fda-ff42-4054-9f39-8e142296107b+10:2356:x1869324914551552:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1782727444.490007:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6e0ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecaf1fda-ff42-4054-9f39-8e142296107b+10:2356:x1869324914551552:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 84us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727444.490027:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 252 00000100:00100000:1.0:1782727444.490120:0:6949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 55 00000100:00100000:1.0:1782727444.490127:0:6949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e08c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d85bc959-008e-4782-8f39-df709fbb4636+11:2356:x1869324914551808:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1782727444.490158:0:6949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e08c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d85bc959-008e-4782-8f39-df709fbb4636+11:2356:x1869324914551808:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 32us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727444.490164:0:6949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 55 00000100:00100000:2.0:1782727444.492976:0:6951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 56 00000100:00100000:2.0:1782727444.492994:0:6951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e08dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d85bc959-008e-4782-8f39-df709fbb4636+8:2355:x1869324914551936:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1782727444.493083:0:6951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e08dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d85bc959-008e-4782-8f39-df709fbb4636+8:2355:x1869324914551936:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 94us (3425us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727444.493090:0:6951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 56 00000100:00100000:3.0:1782727444.495872:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 129 00000100:00100000:3.0:1782727444.495899:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e08ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d85bc959-008e-4782-8f39-df709fbb4636+17:2355:x1869324914551680:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1782727444.495996:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e08ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d85bc959-008e-4782-8f39-df709fbb4636+17:2355:x1869324914551680:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 112us (6416us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727444.496004:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 129 00000100:00080000:0.0:1782727444.497005:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782727444.497013:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782727444.497016:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00020000:2.0:1782727444.817205:0:6956:0:(tgt_handler.c:2756:tgt_brw_write()) cfs_fail_timeout id 216 awake 00000100:00100000:2.0:1782727444.834801:0:6956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7d6e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d85bc959-008e-4782-8f39-df709fbb4636+10:2358:x1869324914551424:12345-192.168.202.60@tcp:4:multiop.0 Request processed in 1059342us (1059574us total) trans 0 rc -30/-30 00000100:00100000:2.0:1782727444.834816:0:6956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 3 00002000:00100000:2.0:1782727444.834831:0:6956:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff921c7d6e9880 x1869324914551424/t0(0) o4->d85bc959-008e-4782-8f39-df709fbb4636@192.168.202.60@tcp:314/0 lens 4584/224 e 0 to 0 dl 1782727454 ref 1 fl Complete:/600/0 rc -30/-30 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782727444.834841:0:6956:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff921c7d6e9880 with x1869324914551424 ext(0->4095) 00002000:00010000:2.0:1782727444.834848:0:6956:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff921c7d6e9880 00010000:00010000:2.0:1782727444.989194:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727445.889785:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1782727445.890576:0:6955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914552064 00000100:00100000:2.0:1782727445.890587:0:6955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914552064 00002000:00100000:2.0:1782727445.890640:0:6955:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff921c45e46300 x1869324914552064/t0(0) o4->d85bc959-008e-4782-8f39-df709fbb4636@192.168.202.60@tcp:316/0 lens 4584/0 e 0 to 0 dl 1782727456 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782727445.890652:0:6955:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff921c45e46300 with x1869324914552064 ext(0->4095) 00002000:00010000:2.0:1782727445.890658:0:6955:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff921c45e46300 00000100:00100000:2.0:1782727445.890699:0:6955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 4 00000100:00100000:2.0:1782727445.890710:0:6955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c45e46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d85bc959-008e-4782-8f39-df709fbb4636+10:2358:x1869324914552064:12345-192.168.202.60@tcp:4:multiop.0 00000001:00020000:2.0:1782727445.890749:0:6955:0:(tgt_handler.c:2756:tgt_brw_write()) cfs_fail_timeout id 216 sleeping for 1000ms 00000001:00020000:2.0:1782727446.002045:0:6955:0:(tgt_handler.c:2756:tgt_brw_write()) cfs_fail_timeout interrupted 00000100:00100000:3.0:1782727446.009799:0:6955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c45e46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d85bc959-008e-4782-8f39-df709fbb4636+10:2358:x1869324914552064:12345-192.168.202.60@tcp:4:multiop.0 Request processed in 118236us (119178us total) trans 0 rc -30/-30 00000100:00100000:3.0:1782727446.009826:0:6955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 4 00002000:00100000:3.0:1782727446.009844:0:6955:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff921c45e46300 x1869324914552064/t0(0) o4->d85bc959-008e-4782-8f39-df709fbb4636@192.168.202.60@tcp:316/0 lens 4584/224 e 0 to 0 dl 1782727456 ref 1 fl Complete:/600/0 rc -30/-30 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782727446.009855:0:6955:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff921c45e46300 with x1869324914552064 ext(0->4095) 00002000:00010000:3.0:1782727446.009863:0:6955:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff921c45e46300 00010000:00010000:0.0:1782727446.010397:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727447.033151:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727448.061269:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727448.066423:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1782727448.066679:0:6956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914552192 00000100:00100000:2.0:1782727448.066690:0:6956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914552192 00002000:00100000:2.0:1782727448.066759:0:6956:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff921c7e08c700 x1869324914552192/t0(0) o4->d85bc959-008e-4782-8f39-df709fbb4636@192.168.202.60@tcp:319/0 lens 4584/0 e 0 to 0 dl 1782727459 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782727448.066771:0:6956:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff921c7e08c700 with x1869324914552192 ext(0->4095) 00002000:00010000:2.0:1782727448.067092:0:6956:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff921c7e08c700 00000100:00100000:2.0:1782727448.067188:0:6956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 5 00000100:00100000:2.0:1782727448.067200:0:6956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e08c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d85bc959-008e-4782-8f39-df709fbb4636+10:2357:x1869324914552192:12345-192.168.202.60@tcp:4:multiop.0 00000100:00080000:0.0:1782727448.067208:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782727448.069194:0:6956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e08c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d85bc959-008e-4782-8f39-df709fbb4636+11:2357:x1869324914552192:12345-192.168.202.60@tcp:4:multiop.0 Request processed in 1988us (2771us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1782727448.069208:0:6956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 5 00002000:00100000:2.0:1782727448.069219:0:6956:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff921c7e08c700 x1869324914552192/t4294967302(0) o4->d85bc959-008e-4782-8f39-df709fbb4636@192.168.202.60@tcp:319/0 lens 4584/448 e 0 to 0 dl 1782727459 ref 1 fl Complete:/600/0 rc 0/0 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782727448.069231:0:6956:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff921c7e08c700 with x1869324914552192 ext(0->4095) 00002000:00010000:2.0:1782727448.069238:0:6956:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff921c7e08c700 00000001:00080000:2.0:1782727448.071435:0:6943:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:0.0:1782727448.076222:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1782727448.078163:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914552320 00000100:00100000:2.0:1782727448.078177:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914552320 00000100:00100000:2.0:1782727448.078269:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 53 00000100:00100000:2.0:1782727448.078283:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e1ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d85bc959-008e-4782-8f39-df709fbb4636+17:11915:x1869324914552320:12345-192.168.202.60@tcp:44:multiop.0 00000100:00080000:0.0:1782727448.078320:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:0.0:1782727448.079646:0:5929:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000004:00080000:0.0:1782727448.079717:0:5929:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000001:00080000:0.0:1782727448.079735:0:5929:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967323 is committed 00000004:00080000:0.0:1782727448.079741:0:5929:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000100:00100000:1.0:1782727448.079848:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782727448.079921:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e08f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869324939751040:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782727448.079993:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727448.080035:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e2ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869324939751168:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782727448.080055:0:6949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939751040 00000100:00100000:1.0:1782727448.080060:0:6949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939751040 00000100:00100000:2.0:1782727448.080072:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727448.080099:0:6949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939751168 00000100:00100000:1.0:1782727448.080102:0:6949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939751168 00000100:00080000:3.0:1782727448.080178:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782727448.080182:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782727448.081060:0:6949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1782727448.081081:0:6949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e08c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324939751040:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782727448.081083:0:9464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1782727448.081091:0:9464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e2af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3442:x1869324939751168:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1782727448.081107:0:9464:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00080000:1.0:1782727448.081107:0:6949:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00010000:00010000:2.0:1782727448.081133:0:9464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b59133e5/0x14a47870ee88cffd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727448.081133:0:6949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000055c5696/0x14a47870ee88cff6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727448.081154:0:9464:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a7398ec5/0x14a47870ee88cf6a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf17d expref: 6 pid: 6950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727448.081155:0:6949:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004abbec9d/0x14a47870ee88cf71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf184 expref: 7 pid: 6951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727448.081164:0:9464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=6s v=(0 0) 00010000:00010000:1.0:1782727448.081164:0:6949:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=6s v=(0 0) 00010000:00010000:2.0:1782727448.081168:0:9464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782727448.081168:0:6949:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782727448.081174:0:9464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b59133e5/0x14a47870ee88cffd lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727448.081174:0:6949:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000055c5696/0x14a47870ee88cff6 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727448.081201:0:9464:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a7398ec5/0x14a47870ee88cf6a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf17d expref: 6 pid: 6950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727448.081201:0:6949:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004abbec9d/0x14a47870ee88cf71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf184 expref: 7 pid: 6951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727448.081216:0:6949:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004abbec9d/0x14a47870ee88cf71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf184 expref: 7 pid: 6951 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727448.081217:0:9464:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a7398ec5/0x14a47870ee88cf6a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf17d expref: 6 pid: 6950 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727448.081230:0:9464:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e2adf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9464:1869324939751296:192.168.202.60@tcp:104: 00000100:00100000:1.0:1782727448.081230:0:6949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e08d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6949:1869324939751424:192.168.202.60@tcp:104: 00000100:00100000:2.0:1782727448.081294:0:9464:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c7d6c0300 going to sleep for 11 seconds 00000100:00100000:1.0:1782727448.084737:0:6949:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c7e234600 going to sleep for 11 seconds 00000004:00080000:0.0:1782727448.085478:0:5929:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000100:00100000:2.0:1782727448.085674:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e1ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d85bc959-008e-4782-8f39-df709fbb4636+7:11915:x1869324914552320:12345-192.168.202.60@tcp:44:multiop.0 Request processed in 7390us (9454us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727448.085686:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 53 00000100:00100000:0.0:1782727448.095603:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1782727448.095879:0:6949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e08d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6949:1869324939751424:192.168.202.60@tcp:104: 00010000:00010000:1.0:1782727448.095962:0:6949:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000055c5696/0x14a47870ee88cff6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727448.097079:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1782727448.097160:0:5936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914552576 00000100:00100000:0.0:1782727448.097168:0:5936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914552576 00010000:00010000:0.0:1782727448.097225:0:5936:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004abbec9d/0x14a47870ee88cf71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf184 expref: 8 pid: 6951 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727448.097263:0:5936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 31 00000100:00100000:0.0:1782727448.097272:0:5936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e08d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d85bc959-008e-4782-8f39-df709fbb4636+8:2357:x1869324914552576:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782727448.097286:0:5936:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782727448.097292:0:5936:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004abbec9d/0x14a47870ee88cf71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf184 expref: 8 pid: 6951 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727448.097306:0:5936:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004abbec9d/0x14a47870ee88cf71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf184 expref: 8 pid: 6951 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727448.097348:0:5936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004abbec9d/0x14a47870ee88cf71 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf184 expref: 8 pid: 6951 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727448.097365:0:5936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782727448.097369:0:5936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782727448.097374:0:5936:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000055c5696/0x14a47870ee88cff6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727448.097384:0:5936:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000055c5696/0x14a47870ee88cff6 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727448.097410:0:5936:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782727448.097457:0:5936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e08d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d85bc959-008e-4782-8f39-df709fbb4636+7:2357:x1869324914552576:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 186us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727448.097465:0:5936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 31 00000100:00080000:3.0:1782727448.097526:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1782727448.097671:0:6949:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000055c5696/0x14a47870ee88cff6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727448.097681:0:6949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000055c5696/0x14a47870ee88cff6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727448.097690:0:6949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000055c5696/0x14a47870ee88cff6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727448.097697:0:6949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000055c5696/0x14a47870ee88cff6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727448.097721:0:6949:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782727448.097946:0:8027:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782727448.097952:0:8027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000055c5696/0x14a47870ee88cff6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727448.097960:0:8027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c76669200 already unused, calling callback (ffffffffc0c98cf0) 00010000:00010000:0.0:1782727448.097964:0:8027:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000055c5696/0x14a47870ee88cff6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727448.097973:0:8027:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000055c5696/0x14a47870ee88cff6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727448.097997:0:8027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000055c5696/0x14a47870ee88cff6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727448.098004:0:8027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000055c5696/0x14a47870ee88cff6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727448.098022:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727448.098024:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727448.098025:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727448.098315:0:6949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e08c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3444:x1869324939751040:12345-0@lo:6:osp-syn-1-0.0 Request processed in 17238us (18320us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1782727448.098324:0:6949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1782727448.098343:0:6949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914552448 00000100:00100000:1.0:1782727448.098348:0:6949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914552448 00000004:00080000:0.0:1782727448.099253:0:3444:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff921c7e08f480/2, rc 0, transno 4294967302 00000100:00100000:0.0:1782727448.099263:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e08f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869324939751040:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782727448.099354:0:6951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 25 00000100:00100000:2.0:1782727448.099368:0:6951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d85bc959-008e-4782-8f39-df709fbb4636+7:2357:x1869324914552448:12345-192.168.202.60@tcp:16:multiop.0 00000100:00100000:2.0:1782727448.099461:0:6951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d85bc959-008e-4782-8f39-df709fbb4636+7:2357:x1869324914552448:12345-192.168.202.60@tcp:16:multiop.0 Request processed in 98us (3869us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727448.099468:0:6951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 25 00000100:00100000:3.0:1782727448.100568:0:9464:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e2adf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9464:1869324939751296:192.168.202.60@tcp:104: 00010000:00010000:3.0:1782727448.100598:0:9464:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b59133e5/0x14a47870ee88cffd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727448.109369:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1782727448.109534:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1782727448.109566:0:5935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914552704 00000100:00100000:1.0:1782727448.109585:0:5935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914552704 00010000:00010000:1.0:1782727448.109622:0:5935:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a7398ec5/0x14a47870ee88cf6a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf17d expref: 7 pid: 6950 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727448.109657:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 32 00000100:00100000:1.0:1782727448.109666:0:5935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5302c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d85bc959-008e-4782-8f39-df709fbb4636+7:2358:x1869324914552704:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782727448.109680:0:5935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782727448.109686:0:5935:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a7398ec5/0x14a47870ee88cf6a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf17d expref: 7 pid: 6950 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727448.109699:0:5935:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a7398ec5/0x14a47870ee88cf6a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf17d expref: 7 pid: 6950 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727448.109722:0:5935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a7398ec5/0x14a47870ee88cf6a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf17d expref: 7 pid: 6950 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727448.109737:0:5935:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782727448.109740:0:5935:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782727448.109745:0:5935:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b59133e5/0x14a47870ee88cffd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727448.109751:0:5935:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b59133e5/0x14a47870ee88cffd lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727448.109775:0:5935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782727448.109824:0:5935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5302c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d85bc959-008e-4782-8f39-df709fbb4636+6:2358:x1869324914552704:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 159us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727448.109840:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 32 00010000:00010000:2.0:1782727448.110048:0:9464:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b59133e5/0x14a47870ee88cffd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727448.110058:0:9464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b59133e5/0x14a47870ee88cffd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727448.110067:0:9464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b59133e5/0x14a47870ee88cffd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727448.110074:0:9464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b59133e5/0x14a47870ee88cffd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727448.110097:0:9464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1782727448.110262:0:9464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e2af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3442:x1869324939751168:12345-0@lo:6:osp-syn-0-0.0 Request processed in 29171us (30187us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1782727448.110270:0:9464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1782727448.110322:0:5938:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782727448.110328:0:5938:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b59133e5/0x14a47870ee88cffd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727448.110337:0:5938:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c7df49400 already unused, calling callback (ffffffffc0c98cf0) 00010000:00010000:1.0:1782727448.110347:0:5938:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b59133e5/0x14a47870ee88cffd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727448.110356:0:5938:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b59133e5/0x14a47870ee88cffd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727448.110368:0:5938:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b59133e5/0x14a47870ee88cffd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727448.110374:0:5938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b59133e5/0x14a47870ee88cffd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727448.110392:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727448.110394:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727448.110395:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1782727448.110627:0:3442:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff921c7e2ac380/2, rc 0, transno 4294967303 00000100:00100000:3.0:1782727448.110634:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e2ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869324939751168:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782727448.111203:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914552960 00000100:00100000:0.0:1782727448.111210:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914552960 00000100:00100000:0.0:1782727448.111288:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 11 00000100:00100000:0.0:1782727448.111297:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e08d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d85bc959-008e-4782-8f39-df709fbb4636+7:11915:x1869324914552960:12345-192.168.202.60@tcp:35:multiop.0 00000001:00080000:0.0:1782727448.111502:0:5951:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:0.0:1782727448.111591:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e08d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d85bc959-008e-4782-8f39-df709fbb4636+9:11915:x1869324914552960:12345-192.168.202.60@tcp:35:multiop.0 Request processed in 295us (2231us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1782727448.111599:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 11 00000020:00080000:0.0:1782727448.111603:0:5951:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000001:00080000:3.0:1782727448.111737:0:8019:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:3.0:1782727448.111745:0:8019:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:1.0:1782727448.191731:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1782727448.191849:0:12227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914553088 00000100:00100000:0.0:1782727448.191859:0:12227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914553088 00000100:00100000:0.0:1782727448.192699:0:12227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 54 00000100:00100000:0.0:1782727448.192715:0:12227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e08d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d85bc959-008e-4782-8f39-df709fbb4636+9:11971:x1869324914553088:12345-192.168.202.60@tcp:101:rm.0 00010000:00010000:0.0:1782727448.192740:0:12227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727448.192778:0:12227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1800/0x14a47870ee88d004 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1752a87bbfbdf1ae expref: -99 pid: 12227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727448.192854:0:12227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0c00/0x14a47870ee88d00b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727448.192868:0:12227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0c00/0x14a47870ee88d00b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727448.192878:0:12227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0c00/0x14a47870ee88d00b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782727448.192953:0:12227:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1782727448.192957:0:12227:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782727448.192978:0:12227:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0c00/0x14a47870ee88d00b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727448.193003:0:12227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1800/0x14a47870ee88d004 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf1ae expref: 11 pid: 12227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727448.193022:0:12227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0c00/0x14a47870ee88d00b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf1ae expref: 10 pid: 12227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727448.193031:0:12227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921c46b9e200) 00010000:00010000:0.0:1782727448.193034:0:12227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782727448.193037:0:12227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c7a3e0c00, rc 0) 00000100:00100000:0.0:1782727448.193106:0:12227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e08d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d85bc959-008e-4782-8f39-df709fbb4636+10:11971:x1869324914553088:12345-192.168.202.60@tcp:101:rm.0 Request processed in 396us (1385us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727448.193114:0:12227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 54 00000100:00100000:2.0:1782727448.199177:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1782727448.199358:0:12227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914553344 00000100:00100000:0.0:1782727448.199378:0:12227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914553344 00000100:00100000:0.0:1782727448.199424:0:12227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 55 00000100:00100000:0.0:1782727448.199430:0:12227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e2adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d85bc959-008e-4782-8f39-df709fbb4636+10:11971:x1869324914553344:12345-192.168.202.60@tcp:36:rm.0 00010000:00010000:0.0:1782727448.199482:0:12227:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1782727448.199509:0:12227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0a00/0x14a47870ee88cfe1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf1a0 expref: 10 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727448.199528:0:12227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff921c58b4c900) 00010000:00010000:0.0:1782727448.199545:0:12227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0c00/0x14a47870ee88d00b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf1ae expref: 9 pid: 12227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727448.199553:0:12227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921c46b9e200) 00010000:00010000:0.0:1782727448.199559:0:12227:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782727448.199581:0:12227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1000/0x14a47870ee88d012 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727448.199594:0:12227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1000/0x14a47870ee88d012 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727448.199602:0:12227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1000/0x14a47870ee88d012 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727448.199615:0:12227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1a00/0x14a47870ee88d019 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727448.199622:0:12227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1a00/0x14a47870ee88d019 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727448.199628:0:12227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1a00/0x14a47870ee88d019 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727448.199707:0:12227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1200/0x14a47870ee88d020 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727448.199712:0:12227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1200/0x14a47870ee88d020 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727448.199716:0:12227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1200/0x14a47870ee88d020 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782727448.200025:0:12227:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:0.0:1782727448.200032:0:12227:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 342958148304ns, next at 343958146803ns, rc = 0 00010000:00010000:0.0:1782727448.200067:0:12227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff921c8215f000/0x14a47870ee88d027 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727448.200074:0:12227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c8215f000/0x14a47870ee88d027 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727448.200079:0:12227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c8215f000/0x14a47870ee88d027 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727448.200083:0:12227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff921c8215f000/0x14a47870ee88d027 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727448.200087:0:12227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff921c8215f000/0x14a47870ee88d027 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727448.200091:0:12227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921c8215f000/0x14a47870ee88d027 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727448.200131:0:12227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782727448.200143:0:12227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1200/0x14a47870ee88d020 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727448.200152:0:12227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1200/0x14a47870ee88d020 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727448.200157:0:12227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1200/0x14a47870ee88d020 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727448.200161:0:12227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c7a3e1200 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:0.0:1782727448.200164:0:12227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1200/0x14a47870ee88d020 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727448.200168:0:12227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1200/0x14a47870ee88d020 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727448.200174:0:12227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff921c46b9ec00) 00010000:00010000:0.0:1782727448.200175:0:12227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782727448.200177:0:12227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1200/0x14a47870ee88d020 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727448.200181:0:12227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1200/0x14a47870ee88d020 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727448.200192:0:12227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1000/0x14a47870ee88d012 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727448.200195:0:12227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1000/0x14a47870ee88d012 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727448.200199:0:12227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1000/0x14a47870ee88d012 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727448.200201:0:12227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c7a3e1000 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:0.0:1782727448.200208:0:12227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1000/0x14a47870ee88d012 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727448.200211:0:12227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1000/0x14a47870ee88d012 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727448.200215:0:12227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921c46b9ef00) 00010000:00010000:0.0:1782727448.200217:0:12227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782727448.200218:0:12227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1000/0x14a47870ee88d012 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727448.200221:0:12227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1000/0x14a47870ee88d012 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782727448.200228:0:12227:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000554639ae reply state 000000004fa85df8 transno 4294967326 ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1a00/0x14a47870ee88d019 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727448.200233:0:12227:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782727448.200285:0:12227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e2adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d85bc959-008e-4782-8f39-df709fbb4636+10:11971:x1869324914553344:12345-192.168.202.60@tcp:36:rm.0 Request processed in 855us (1118us total) trans 4294967326 rc 0/0 00000100:00100000:0.0:1782727448.200290:0:12227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 55 00010000:00010000:3.0:1782727448.202140:0:3429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1a00/0x14a47870ee88d019 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727448.202155:0:3429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1a00/0x14a47870ee88d019 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727448.202161:0:3429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1a00/0x14a47870ee88d019 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727448.202168:0:3429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c7a3e1a00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1782727448.202174:0:3429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1a00/0x14a47870ee88d019 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727448.202193:0:3429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1a00/0x14a47870ee88d019 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727448.202208:0:3429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x11a4e1a9 (ffff921c46b9e600) 00010000:00010000:3.0:1782727448.202210:0:3429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782727448.202213:0:3429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1a00/0x14a47870ee88d019 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727448.202218:0:3429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1a00/0x14a47870ee88d019 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727448.203126:0:5937:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782727448.203135:0:5937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921c8215f000/0x14a47870ee88d027 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727448.203142:0:5937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c8215f000 already unused, calling callback (ffffffffc0c98cf0) 00010000:00010000:2.0:1782727448.203156:0:5937:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c8215f000/0x14a47870ee88d027 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727448.203162:0:5937:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c8215f000/0x14a47870ee88d027 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727448.203173:0:5937:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff921c46b9ec00) 00010000:00010000:2.0:1782727448.203175:0:5937:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1782727448.203179:0:5937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921c8215f000/0x14a47870ee88d027 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727448.203184:0:5937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c8215f000/0x14a47870ee88d027 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727448.203201:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727448.203203:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727448.203204:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727449.082166:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727449.275080:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e2ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c71e9f0f-6441-4b9b-bc96-153ab9250801:3443:1869324939751552:0@lo:400:kworker.0 00000100:00100000:2.0:1782727449.275151:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727449.275194:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e2ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3443:1869324939752064:0@lo:400:kworker.0 00000100:00100000:2.0:1782727449.275220:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727449.275244:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782727449.275249:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e2ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869324939751936:0@lo:400:kworker.0 00000100:00100000:2.0:1782727449.275272:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727449.275302:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e2af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869324939751680:0@lo:400:kworker.0 00000100:00100000:2.0:1782727449.275325:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727449.275803:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e2ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869324939752192:0@lo:400:kworker.0 00000100:00100000:2.0:1782727449.275830:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727449.275851:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782727449.275872:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e2ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3444:1869324939751808:0@lo:400:kworker.0 00000100:00100000:2.0:1782727449.276004:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727449.276043:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939751552 00000100:00100000:2.0:1782727449.276052:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939751552 00000100:00100000:2.0:1782727449.276103:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1782727449.276113:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6e0fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:3443:x1869324939751552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727449.276163:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6e0fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:3443:x1869324939751552:12345-0@lo:400:kworker.0 Request processed in 51us (1012us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727449.276170:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1782727449.276204:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939752064 00000100:00100000:2.0:1782727449.276208:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939752064 00000100:00100000:2.0:1782727449.276245:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939751680 00000100:00100000:2.0:1782727449.276248:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939751680 00000100:00100000:2.0:1782727449.276258:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939751808 00000100:00100000:2.0:1782727449.276260:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939751808 00000100:00100000:2.0:1782727449.276273:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1782727449.276278:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e2ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1869324939752064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727449.276308:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e2ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1869324939752064:12345-0@lo:400:kworker.0 Request processed in 30us (1087us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727449.276314:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1782727449.276325:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000004:00080000:1.0:1782727449.276494:0:7421:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 344034609973ns, next at 345034607033ns, rc = 0 00000100:00100000:1.0:1782727449.276524:0:6949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939751936 00000100:00100000:1.0:1782727449.276528:0:6949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939751936 00000100:00100000:1.0:1782727449.276553:0:6949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939752192 00000100:00100000:1.0:1782727449.276556:0:6949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939752192 00000100:00100000:1.0:1782727449.276583:0:6949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1782727449.276589:0:6949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e2afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3443:x1869324939751936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727449.276626:0:6949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e2afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3443:x1869324939751936:12345-0@lo:400:kworker.0 Request processed in 38us (1353us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727449.276632:0:6949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1782727449.276646:0:6949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1782727449.276651:0:6949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e2aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324939752192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727449.276677:0:6949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e2aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324939752192:12345-0@lo:400:kworker.0 Request processed in 26us (847us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727449.276683:0:6949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1782727449.276701:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1782727449.276707:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e2ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869324939751808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727449.276748:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e2ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869324939751808:12345-0@lo:400:kworker.0 Request processed in 41us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727449.276754:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1782727449.276776:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e08e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869324939752320:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782727449.276802:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727449.276831:0:6952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939752320 00000100:00100000:1.0:1782727449.276836:0:6952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939752320 00000100:00100000:1.0:1782727449.276859:0:6952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1782727449.276866:0:6952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e08f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3445:x1869324939752320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782727449.276913:0:6952:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 28672 granted 25408064 pending 0 free 3923664896 avail 3692142592 00000100:00100000:1.0:1782727449.277184:0:6952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e08f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3445:x1869324939752320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 317us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727449.277190:0:6952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1782727449.277230:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e2ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3444:1869324939751808:0@lo:400:kworker.0 00000100:00100000:1.0:1782727449.277251:0:3444:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967302 gen 2 00000004:00080000:1.0:1782727449.277255:0:3444:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff921c7e08f480, transno 4294967302 00000100:00100000:1.0:1782727449.277266:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e2ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869324939752192:0@lo:400:kworker.0 00000100:00100000:3.0:1782727449.277433:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e08e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869324939752320:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782727449.277511:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e2ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869324939751680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727449.277559:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e2ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869324939751680:12345-0@lo:400:kworker.0 Request processed in 1228us (2232us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727449.277565:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:2.0:1782727449.277598:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782727449.277619:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e2ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869324939751936:0@lo:400:kworker.0 00000100:00100000:2.0:1782727449.277639:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e2ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c71e9f0f-6441-4b9b-bc96-153ab9250801:3443:1869324939751552:0@lo:400:kworker.0 00000100:00100000:2.0:1782727449.277650:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e2ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3443:1869324939752064:0@lo:400:kworker.0 00000100:00100000:3.0:1782727449.277855:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e2af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869324939751680:0@lo:400:kworker.0 00000100:00100000:1.0:1782727449.278491:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782727449.278503:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e2ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869324939752448:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782727449.278540:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727449.278612:0:6952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939752448 00000100:00100000:2.0:1782727449.278618:0:6952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939752448 00000100:00100000:2.0:1782727449.278654:0:6952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1782727449.278661:0:6952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e08f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1869324939752448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782727449.278682:0:6952:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1782727449.278872:0:6952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e08f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1869324939752448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 210us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727449.278879:0:6952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1782727449.283051:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e2ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869324939752448:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782727449.615135:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1782727449.615184:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1782727449.615219:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1782727449.615257:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1782727449.615338:0:6949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914553728 00000100:00100000:3.0:1782727449.615348:0:6949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914553728 00000100:00100000:3.0:1782727449.615401:0:6949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914553856 00000100:00100000:3.0:1782727449.615405:0:6949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914553856 00000100:00100000:3.0:1782727449.615427:0:6949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 59 00000100:00100000:3.0:1782727449.615437:0:6949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e2ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d85bc959-008e-4782-8f39-df709fbb4636+6:2356:x1869324914553728:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1782727449.615505:0:6949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e2ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d85bc959-008e-4782-8f39-df709fbb4636+6:2356:x1869324914553728:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 69us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727449.615513:0:6949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 59 00000100:00100000:3.0:1782727449.615530:0:6949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 60 00000100:00100000:3.0:1782727449.615536:0:6949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e2af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d85bc959-008e-4782-8f39-df709fbb4636+6:2356:x1869324914553856:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1782727449.615561:0:6949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e2af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d85bc959-008e-4782-8f39-df709fbb4636+6:2356:x1869324914553856:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 25us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727449.615583:0:6949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 60 00000100:00100000:1.0:1782727449.616121:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914553472 00000100:00100000:1.0:1782727449.616127:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914553472 00000100:00100000:1.0:1782727449.616175:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 254 00000100:00100000:1.0:1782727449.616184:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6e0fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecaf1fda-ff42-4054-9f39-8e142296107b+10:2356:x1869324914553472:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1782727449.616218:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6e0fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecaf1fda-ff42-4054-9f39-8e142296107b+10:2356:x1869324914553472:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 36us (1094us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727449.616225:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 254 00000100:00100000:0.0:1782727449.616595:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914553600 00000100:00100000:0.0:1782727449.616601:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914553600 00000100:00100000:0.0:1782727449.616647:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 133 00000100:00100000:0.0:1782727449.616656:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e2ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d85bc959-008e-4782-8f39-df709fbb4636+9:2356:x1869324914553600:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1782727449.616802:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e2ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d85bc959-008e-4782-8f39-df709fbb4636+9:2356:x1869324914553600:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 147us (1582us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727449.616809:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 133 00010000:00010000:1.0:1782727450.105800:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727451.130737:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727452.153078:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727453.177124:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727454.211439:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1782727454.393566:0:7421:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 349151680309ns, next at 350151677433ns, rc = 0 00000100:00100000:1.0:1782727454.393758:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e08f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869324939752576:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782727454.393825:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727454.394608:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e0d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869324939752704:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782727454.394643:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727454.394684:0:6952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939752576 00000100:00100000:0.0:1782727454.394691:0:6952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939752576 00000100:00100000:0.0:1782727454.394732:0:6952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939752704 00000100:00100000:0.0:1782727454.394734:0:6952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939752704 00000100:00100000:0.0:1782727454.394748:0:6952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1782727454.394756:0:6952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c768dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3443:x1869324939752576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782727454.394782:0:6952:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 28672 granted 25408064 pending 0 free 3923664896 avail 3692142592 00000100:00100000:0.0:1782727454.394822:0:6952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c768dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3443:x1869324939752576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (997us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727454.394829:0:6952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1782727454.395023:0:6952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1782727454.395031:0:6952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324939752704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782727454.395046:0:6952:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1782727454.395074:0:6952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324939752704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727454.395080:0:6952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:0.0:1782727454.395095:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782727454.395099:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782727454.395129:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e0d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869324939752704:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782727454.401471:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e08f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869324939752576:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782727454.401707:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e0d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3442:1869324939752960:0@lo:400:kworker.0 00000100:00100000:0.0:1782727454.401773:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727454.401810:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782727454.401816:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e0d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3442:1869324939753088:0@lo:400:kworker.0 00000100:00100000:0.0:1782727454.401838:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727454.401973:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e0d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c71e9f0f-6441-4b9b-bc96-153ab9250801:3445:1869324939752832:0@lo:400:kworker.0 00000100:00100000:1.0:1782727454.402006:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727454.402377:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e0d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3444:1869324939753216:0@lo:400:kworker.0 00000100:00100000:0.0:1782727454.402404:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727454.403504:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939752832 00000100:00100000:1.0:1782727454.403516:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939752832 00000100:00100000:1.0:1782727454.403566:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1782727454.403574:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c6e0ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:3445:x1869324939752832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727454.403642:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c6e0ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:3445:x1869324939752832:12345-0@lo:400:kworker.0 Request processed in 68us (1634us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727454.403650:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1782727454.403703:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e0d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c71e9f0f-6441-4b9b-bc96-153ab9250801:3445:1869324939752832:0@lo:400:kworker.0 00000100:00100000:2.0:1782727454.403811:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939752960 00000100:00100000:2.0:1782727454.403815:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939752960 00000100:00100000:2.0:1782727454.403862:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939753088 00000100:00100000:2.0:1782727454.403866:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939753088 00000100:00100000:2.0:1782727454.403914:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939753216 00000100:00100000:2.0:1782727454.403917:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939753216 00000100:00100000:2.0:1782727454.403931:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1782727454.403937:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dfcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1869324939752960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727454.403978:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dfcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1869324939752960:12345-0@lo:400:kworker.0 Request processed in 41us (2206us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727454.403983:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1782727454.404002:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1782727454.404008:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e033480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1869324939753088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727454.404037:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e033480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1869324939753088:12345-0@lo:400:kworker.0 Request processed in 30us (2198us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727454.404043:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1782727454.404053:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1782727454.404058:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e031880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1869324939753216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727454.404086:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e031880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1869324939753216:12345-0@lo:400:kworker.0 Request processed in 27us (1680us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727454.404091:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:2.0:1782727454.404111:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782727454.404135:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e0d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3442:1869324939753088:0@lo:400:kworker.0 00000100:00100000:2.0:1782727454.404147:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e0d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3442:1869324939752960:0@lo:400:kworker.0 00000100:00100000:0.0:1782727454.404514:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e0d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3444:1869324939753216:0@lo:400:kworker.0 00000004:00080000:3.0:1782727454.404661:0:5929:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000001:00080000:3.0:1782727454.404717:0:5929:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967326 is committed 00000004:00080000:3.0:1782727454.404722:0:5929:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000100:00100000:0.0:1782727454.404833:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782727454.404843:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e2aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869324939753344:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782727454.405126:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727454.405221:0:6949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939753344 00000100:00100000:2.0:1782727454.405226:0:6949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939753344 00000100:00100000:2.0:1782727454.405266:0:6949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1782727454.405272:0:6949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e033b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3444:x1869324939753344:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1782727454.405304:0:6949:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00010000:00010000:2.0:1782727454.405328:0:6949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac449f95/0x14a47870ee88d02e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727454.405349:0:6949:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d3e7f56a/0x14a47870ee88cfef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf1a7 expref: 5 pid: 6950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727454.405357:0:6949:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=11s v=(0 0) 00010000:00010000:2.0:1782727454.405361:0:6949:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782727454.405373:0:6949:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac449f95/0x14a47870ee88d02e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727454.405400:0:6949:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d3e7f56a/0x14a47870ee88cfef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf1a7 expref: 5 pid: 6950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727454.405413:0:6949:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d3e7f56a/0x14a47870ee88cfef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf1a7 expref: 5 pid: 6950 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727454.405426:0:6949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e2ad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6949:1869324939753472:192.168.202.60@tcp:104: 00000100:00100000:2.0:1782727454.405479:0:6949:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c7e234240 going to sleep for 11 seconds 00000100:00100000:3.0:1782727454.420436:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1782727454.420466:0:5935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914553984 00000100:00100000:3.0:1782727454.420475:0:5935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914553984 00010000:00010000:3.0:1782727454.420520:0:5935:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d3e7f56a/0x14a47870ee88cfef lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf1a7 expref: 6 pid: 6950 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727454.420556:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 33 00000100:00100000:3.0:1782727454.420565:0:5935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c45e44e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d85bc959-008e-4782-8f39-df709fbb4636+6:2358:x1869324914553984:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782727454.420580:0:5935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782727454.420586:0:5935:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d3e7f56a/0x14a47870ee88cfef lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf1a7 expref: 6 pid: 6950 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727454.420598:0:5935:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d3e7f56a/0x14a47870ee88cfef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf1a7 expref: 6 pid: 6950 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727454.420624:0:5935:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782727454.420629:0:5935:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782727454.420635:0:5935:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ac449f95/0x14a47870ee88d02e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727454.420645:0:5935:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac449f95/0x14a47870ee88d02e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727454.420680:0:5935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782727454.420730:0:5935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c45e44e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d85bc959-008e-4782-8f39-df709fbb4636+6:2358:x1869324914553984:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 166us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727454.420737:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 33 00010000:00010000:2.0:1782727454.423640:0:6949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3e7f56a/0x14a47870ee88cfef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf1a7 expref: 5 pid: 6950 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727454.423663:0:6949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e2ad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6949:1869324939753472:192.168.202.60@tcp:104: 00010000:00010000:2.0:1782727454.423686:0:6949:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ac449f95/0x14a47870ee88d02e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727454.423698:0:6949:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ac449f95/0x14a47870ee88d02e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727454.423706:0:6949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac449f95/0x14a47870ee88d02e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727454.423718:0:6949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac449f95/0x14a47870ee88d02e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727454.423739:0:6949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac449f95/0x14a47870ee88d02e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727454.423767:0:6949:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782727454.424988:0:8027:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782727454.424998:0:8027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac449f95/0x14a47870ee88d02e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727454.425010:0:8027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c7df48600 already unused, calling callback (ffffffffc0c98cf0) 00010000:00010000:3.0:1782727454.425015:0:8027:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac449f95/0x14a47870ee88d02e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727454.425025:0:8027:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac449f95/0x14a47870ee88d02e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727454.425046:0:8027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac449f95/0x14a47870ee88d02e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727454.425052:0:8027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac449f95/0x14a47870ee88d02e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727454.425074:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727454.425076:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727454.425077:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1782727454.425142:0:6943:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:2.0:1782727454.426089:0:6949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e033b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3444:x1869324939753344:12345-0@lo:6:osp-syn-0-0.0 Request processed in 20811us (20958us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1782727454.426102:0:6949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1782727454.426138:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782727454.426443:0:3444:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1782727454.426461:0:3444:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff921c7e2ac380, transno 4294967303 00000100:00100000:3.0:1782727454.426486:0:3444:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff921c7e2aea00 x1869324939753344/t4294967304(4294967304) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1782727470 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1782727454.426497:0:3444:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff921c7e2aea00/2, rc 0, transno 4294967304 00000100:00100000:3.0:1782727454.426502:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e2aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869324939753344:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1782727454.723252:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1782727454.723302:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1782727454.723332:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1782727454.723365:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914554112 00000100:00100000:3.0:1782727454.723374:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914554112 00000100:00100000:3.0:1782727454.723422:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 256 00000100:00100000:3.0:1782727454.723432:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fe4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecaf1fda-ff42-4054-9f39-8e142296107b+10:2358:x1869324914554112:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1782727454.723497:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fe4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecaf1fda-ff42-4054-9f39-8e142296107b+10:2358:x1869324914554112:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 67us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727454.723505:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 256 00000100:00100000:3.0:1782727454.723538:0:9464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914554368 00000100:00100000:3.0:1782727454.723541:0:9464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914554368 00000100:00100000:3.0:1782727454.723591:0:9464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 61 00000100:00100000:3.0:1782727454.723598:0:9464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c45e45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d85bc959-008e-4782-8f39-df709fbb4636+6:2358:x1869324914554368:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1782727454.723626:0:9464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c45e45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d85bc959-008e-4782-8f39-df709fbb4636+6:2358:x1869324914554368:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 29us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727454.723632:0:9464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 61 00000100:00080000:3.0:1782727454.723767:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782727454.723832:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914554240 00000100:00100000:0.0:1782727454.723836:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914554240 00000100:00100000:0.0:1782727454.723921:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 137 00000100:00100000:0.0:1782727454.723929:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c45e46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d85bc959-008e-4782-8f39-df709fbb4636+6:2358:x1869324914554240:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1782727454.723962:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c45e46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d85bc959-008e-4782-8f39-df709fbb4636+6:2358:x1869324914554240:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 34us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727454.723968:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 137 00000100:00080000:3.0:1782727454.724426:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:3.0:1782727454.809136:0:12900:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 118d: Fsync validation inject a delay of the bulk ==================================================================== 06:04:12 (1782727452) 00010000:00010000:1.0:1782727455.225673:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727455.540995:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1782727455.541210:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914554496 00000100:00100000:1.0:1782727455.541220:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914554496 00000100:00100000:1.0:1782727455.541336:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 56 00000100:00100000:1.0:1782727455.541350:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c45e45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d85bc959-008e-4782-8f39-df709fbb4636+6:12602:x1869324914554496:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:1.0:1782727455.541370:0:5950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727455.541392:0:5950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668400/0x14a47870ee88d035 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1752a87bbfbdf1b5 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.541457:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669400/0x14a47870ee88d03c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.541472:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669400/0x14a47870ee88d03c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.541484:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669400/0x14a47870ee88d03c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782727455.541627:0:5950:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1782727455.541632:0:5950:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782727455.541655:0:5950:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669400/0x14a47870ee88d03c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.541691:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668400/0x14a47870ee88d035 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf1b5 expref: 8 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.541710:0:5950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669400/0x14a47870ee88d03c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf1b5 expref: 7 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.541718:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921c5fda7400) 00010000:00010000:1.0:1782727455.541721:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782727455.541725:0:5950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c76669400, rc 0) 00000100:00100000:1.0:1782727455.541827:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c45e45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d85bc959-008e-4782-8f39-df709fbb4636+7:12602:x1869324914554496:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 479us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727455.541834:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 56 00000100:00100000:3.0:1782727455.552745:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1782727455.553058:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914554752 00000100:00100000:0.0:1782727455.553069:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914554752 00000100:00100000:0.0:1782727455.553249:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 57 00000100:00100000:0.0:1782727455.553261:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c45e47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d85bc959-008e-4782-8f39-df709fbb4636+7:12602:x1869324914554752:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:0.0:1782727455.553292:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727455.553295:0:5949:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1782727455.553323:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669400/0x14a47870ee88d03c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf1b5 expref: 7 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727455.553345:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921c5fda7400) 00010000:00010000:0.0:1782727455.553356:0:5949:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782727455.553369:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c8215ec00/0x14a47870ee88d043 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1752a87bbfbdf1bc expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727455.553482:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff921c8215e000/0x14a47870ee88d04a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727455.553494:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c8215e000/0x14a47870ee88d04a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727455.553503:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c8215e000/0x14a47870ee88d04a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727455.553527:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff921c8215fe00/0x14a47870ee88d051 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727455.553534:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c8215fe00/0x14a47870ee88d051 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727455.553540:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c8215fe00/0x14a47870ee88d051 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727455.554252:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921c8215f400/0x14a47870ee88d058 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727455.554359:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c8215f400/0x14a47870ee88d058 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727455.554371:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c8215f400/0x14a47870ee88d058 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782727455.554382:0:5949:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x8:0x0]: returning size 0 00010000:00010000:0.0:1782727455.554407:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff921c8215e000/0x14a47870ee88d04a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727455.554413:0:5949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921c8215e000/0x14a47870ee88d04a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727455.554428:0:5949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921c8215e000/0x14a47870ee88d04a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727455.554434:0:5949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c8215e000 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:0.0:1782727455.554438:0:5949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c8215e000/0x14a47870ee88d04a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727455.554445:0:5949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c8215e000/0x14a47870ee88d04a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727455.554455:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921c58b4c900) 00010000:00010000:0.0:1782727455.554458:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782727455.554461:0:5949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921c8215e000/0x14a47870ee88d04a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727455.554467:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c8215e000/0x14a47870ee88d04a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782727455.554480:0:5949:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bfad7102 reply state 000000007ea34ca3 transno 4294967327 ns: mdt-lustre-MDT0000_UUID lock: ffff921c8215fe00/0x14a47870ee88d051 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727455.554488:0:5949:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1782727455.554933:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c8215ec00/0x14a47870ee88d043 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf1bc expref: 9 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727455.555329:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921c8215f400/0x14a47870ee88d058 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf1bc expref: 8 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727455.555339:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0x0 (ffff921c58b4cc00) 00010000:00010000:0.0:1782727455.555341:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782727455.555354:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c8215f400, rc 0) 00000100:00100000:0.0:1782727455.555429:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c45e47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d85bc959-008e-4782-8f39-df709fbb4636+9:12602:x1869324914554752:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 2169us (2693us total) trans 4294967327 rc 0/0 00000100:00100000:0.0:1782727455.555438:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 57 00000100:00100000:3.0:1782727455.560036:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1782727455.560409:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914555008 00000100:00100000:0.0:1782727455.560418:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914555008 00000100:00100000:0.0:1782727455.560467:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 58 00000100:00100000:0.0:1782727455.560476:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c45e44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d85bc959-008e-4782-8f39-df709fbb4636+9:12602:x1869324914555008:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:0.0:1782727455.560499:0:5948:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727455.560521:0:5948:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c8215f000/0x14a47870ee88d066 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1752a87bbfbdf1c3 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727455.560630:0:5948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0e00/0x14a47870ee88d06d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727455.560645:0:5948:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff921c8215f400/0x14a47870ee88d058 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf1bc expref: 10 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727455.560654:0:5948:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0e00/0x14a47870ee88d06d lrc: 4/0,1 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727455.560689:0:5948:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff921c8215f400/0x14a47870ee88d058 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf1bc expref: 10 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727455.560703:0:5948:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff921c8215f400/0x14a47870ee88d058 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf1bc expref: 10 pid: 5949 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727455.560718:0:5948:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e031180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5948:1869324939753600:192.168.202.60@tcp:104: 00000100:00100000:0.0:1782727455.561911:0:5948:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c7deaf000 going to sleep for 11 seconds 00010000:00010000:2.0:1782727455.562007:0:3428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff921c8215fe00/0x14a47870ee88d051 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727455.562017:0:3428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921c8215fe00/0x14a47870ee88d051 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727455.562024:0:3428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921c8215fe00/0x14a47870ee88d051 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727455.562030:0:3428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c8215fe00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1782727455.562034:0:3428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c8215fe00/0x14a47870ee88d051 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727455.562041:0:3428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c8215fe00/0x14a47870ee88d051 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727455.562057:0:3428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe701ffcf (ffff921c58b4c800) 00010000:00010000:2.0:1782727455.562060:0:3428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782727455.562064:0:3428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921c8215fe00/0x14a47870ee88d051 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727455.562085:0:3428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c8215fe00/0x14a47870ee88d051 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727455.573026:0:5948:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e031180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5948:1869324939753600:192.168.202.60@tcp:104: 00010000:00010000:0.0:1782727455.573062:0:5948:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0e00/0x14a47870ee88d06d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727455.583024:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1782727455.583346:0:5934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914555136 00000100:00100000:1.0:1782727455.583358:0:5934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914555136 00010000:00010000:1.0:1782727455.583402:0:5934:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff921c8215f400/0x14a47870ee88d058 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf1bc expref: 10 pid: 5949 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727455.583439:0:5934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 34 00000100:00100000:1.0:1782727455.583448:0:5934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e031180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d85bc959-008e-4782-8f39-df709fbb4636+10:2358:x1869324914555136:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782727455.583463:0:5934:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782727455.583470:0:5934:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff921c8215f400/0x14a47870ee88d058 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf1bc expref: 10 pid: 5949 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.583482:0:5934:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff921c8215f400/0x14a47870ee88d058 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf1bc expref: 10 pid: 5949 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.583539:0:5934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c8215f400/0x14a47870ee88d058 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf1bc expref: 10 pid: 5949 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.583556:0:5934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0x0 (ffff921c58b4cc00) 00010000:00010000:1.0:1782727455.583562:0:5934:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0e00/0x14a47870ee88d06d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.583571:0:5934:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0e00/0x14a47870ee88d06d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.583577:0:5934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0e00/0x14a47870ee88d06d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.583605:0:5934:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782727455.583657:0:5934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e031180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d85bc959-008e-4782-8f39-df709fbb4636+9:2358:x1869324914555136:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 209us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727455.583664:0:5934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 34 00010000:00010000:1.0:1782727455.583693:0:5948:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0e00/0x14a47870ee88d06d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.583702:0:5948:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0e00/0x14a47870ee88d06d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782727455.583720:0:5948:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x8:0x0]: returning size 0 00000004:00080000:1.0:1782727455.583909:0:5948:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00000004:00080000:1.0:1782727455.583917:0:5948:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:1.0:1782727455.584026:0:5948:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0e00/0x14a47870ee88d06d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.584044:0:5948:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0e00/0x14a47870ee88d06d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.584050:0:5948:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0e00/0x14a47870ee88d06d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.584056:0:5948:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c7a3e0e00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1782727455.584061:0:5948:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0e00/0x14a47870ee88d06d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.584068:0:5948:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0e00/0x14a47870ee88d06d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.584077:0:5948:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0x0 (ffff921c58b4cc00) 00010000:00010000:1.0:1782727455.584080:0:5948:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782727455.584083:0:5948:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0e00/0x14a47870ee88d06d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.584090:0:5948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0e00/0x14a47870ee88d06d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.584142:0:5948:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921c8215f000/0x14a47870ee88d066 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf1c3 expref: 9 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.584151:0:5948:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921c58b4c100) 00010000:00010000:1.0:1782727455.584153:0:5948:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782727455.584156:0:5948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c8215f000/0x14a47870ee88d066 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf1c3 expref: 9 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.584169:0:5948:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c8215f000, rc 0) 00000100:00100000:1.0:1782727455.584204:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c45e44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d85bc959-008e-4782-8f39-df709fbb4636+8:12602:x1869324914555008:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 23730us (24179us total) trans 4294967328 rc 301/301 00000100:00100000:1.0:1782727455.584212:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 58 00000100:00100000:0.0:1782727455.592177:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1782727455.592319:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914555392 00000100:00100000:3.0:1782727455.592330:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914555392 00000100:00100000:3.0:1782727455.592418:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 12 00000100:00100000:3.0:1782727455.592429:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e033800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d85bc959-008e-4782-8f39-df709fbb4636+8:12602:x1869324914555392:12345-192.168.202.60@tcp:35:lfs.0 00000100:00100000:3.0:1782727455.592761:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e033800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d85bc959-008e-4782-8f39-df709fbb4636+9:12602:x1869324914555392:12345-192.168.202.60@tcp:35:lfs.0 Request processed in 333us (593us total) trans 4294967329 rc 0/0 00000100:00100000:3.0:1782727455.592768:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 12 00000100:00100000:3.0:1782727455.600612:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1782727455.600727:0:12227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914555520 00000100:00100000:2.0:1782727455.600737:0:12227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914555520 00000100:00100000:2.0:1782727455.600804:0:12227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 59 00000100:00100000:2.0:1782727455.600814:0:12227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d85bc959-008e-4782-8f39-df709fbb4636+9:12602:x1869324914555520:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:2.0:1782727455.600840:0:12227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727455.600875:0:12227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c7df48e00/0x14a47870ee88d07b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1752a87bbfbdf1ca expref: -99 pid: 12227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727455.600979:0:12227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c7df48e00/0x14a47870ee88d07b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf1ca expref: 10 pid: 12227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727455.600994:0:12227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7df48e00/0x14a47870ee88d07b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf1ca expref: 10 pid: 12227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727455.601012:0:12227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0x0 (ffff921c56fbb700) 00010000:00010000:2.0:1782727455.601015:0:12227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782727455.601019:0:12227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c7df48e00, rc 0) 00000100:00100000:2.0:1782727455.601087:0:12227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d85bc959-008e-4782-8f39-df709fbb4636+10:12602:x1869324914555520:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 274us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727455.601094:0:12227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 59 00000100:00100000:2.0:1782727455.616258:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1782727455.616354:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914555776 00000100:00100000:1.0:1782727455.616364:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914555776 00000100:00100000:1.0:1782727455.616425:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 13 00000100:00100000:1.0:1782727455.616435:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e2ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d85bc959-008e-4782-8f39-df709fbb4636+10:12602:x1869324914555776:12345-192.168.202.60@tcp:35:lfs.0 00000100:00100000:1.0:1782727455.616678:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e2ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d85bc959-008e-4782-8f39-df709fbb4636+11:12602:x1869324914555776:12345-192.168.202.60@tcp:35:lfs.0 Request processed in 243us (430us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1782727455.616686:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 13 00000100:00100000:3.0:1782727455.646685:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1782727455.646800:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914555904 00000100:00100000:1.0:1782727455.646812:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914555904 00000100:00100000:1.0:1782727455.646949:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 60 00000100:00100000:1.0:1782727455.646960:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d85bc959-008e-4782-8f39-df709fbb4636+11:12603:x1869324914555904:12345-192.168.202.60@tcp:101:dd.0 00010000:00010000:1.0:1782727455.646987:0:5950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727455.647012:0:5950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668400/0x14a47870ee88d082 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1752a87bbfbdf1d1 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.647078:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669600/0x14a47870ee88d089 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.647092:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669600/0x14a47870ee88d089 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.647104:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669600/0x14a47870ee88d089 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782727455.647150:0:5950:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1782727455.647166:0:5950:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782727455.647188:0:5950:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669600/0x14a47870ee88d089 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.647212:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668400/0x14a47870ee88d082 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf1d1 expref: 13 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.647230:0:5950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669600/0x14a47870ee88d089 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf1d1 expref: 12 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.647239:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921c5fda7500) 00010000:00010000:1.0:1782727455.647242:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782727455.647245:0:5950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c76669600, rc 0) 00000100:00100000:1.0:1782727455.647316:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d85bc959-008e-4782-8f39-df709fbb4636+12:12603:x1869324914555904:12345-192.168.202.60@tcp:101:dd.0 Request processed in 358us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727455.647324:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 60 00000100:00100000:0.0:1782727455.655158:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1782727455.655637:0:12227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914556160 00000100:00100000:2.0:1782727455.655648:0:12227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914556160 00000100:00100000:2.0:1782727455.655722:0:12227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 61 00000100:00100000:2.0:1782727455.655745:0:12227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e030380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d85bc959-008e-4782-8f39-df709fbb4636+12:12603:x1869324914556160:12345-192.168.202.60@tcp:101:dd.0 00010000:00010000:2.0:1782727455.655765:0:12227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727455.655768:0:12227:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1782727455.655795:0:12227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669600/0x14a47870ee88d089 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf1d1 expref: 12 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727455.655817:0:12227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921c5fda7500) 00010000:00010000:2.0:1782727455.655829:0:12227:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782727455.655856:0:12227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c7df49e00/0x14a47870ee88d090 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1752a87bbfbdf1d8 expref: -99 pid: 12227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727455.656047:0:12227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7df49c00/0x14a47870ee88d097 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727455.656063:0:12227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c7df49c00/0x14a47870ee88d097 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727455.656072:0:12227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c7df49c00/0x14a47870ee88d097 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727455.656084:0:12227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7df49600/0x14a47870ee88d09e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727455.656090:0:12227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c7df49600/0x14a47870ee88d09e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727455.656096:0:12227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c7df49600/0x14a47870ee88d09e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727455.656154:0:12227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7df48400/0x14a47870ee88d0a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727455.656168:0:12227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c7df48400/0x14a47870ee88d0a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727455.656176:0:12227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c7df48400/0x14a47870ee88d0a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782727455.656186:0:12227:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x8:0x0]: returning size 0 00010000:00010000:2.0:1782727455.656270:0:12227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7df49c00/0x14a47870ee88d097 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727455.656277:0:12227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921c7df49c00/0x14a47870ee88d097 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727455.656295:0:12227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921c7df49c00/0x14a47870ee88d097 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727455.656302:0:12227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c7df49c00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1782727455.656307:0:12227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c7df49c00/0x14a47870ee88d097 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727455.656314:0:12227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c7df49c00/0x14a47870ee88d097 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727455.656324:0:12227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921c56fbb000) 00010000:00010000:2.0:1782727455.656327:0:12227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782727455.656330:0:12227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921c7df49c00/0x14a47870ee88d097 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727455.656336:0:12227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c7df49c00/0x14a47870ee88d097 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727455.656346:0:12227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7df49600/0x14a47870ee88d09e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727455.656359:0:12227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921c7df49600/0x14a47870ee88d09e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727455.656365:0:12227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921c7df49600/0x14a47870ee88d09e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727455.656370:0:12227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c7df49600 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1782727455.656373:0:12227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c7df49600/0x14a47870ee88d09e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727455.656379:0:12227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c7df49600/0x14a47870ee88d09e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727455.656386:0:12227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe701ffcf (ffff921c56fbb300) 00010000:00010000:2.0:1782727455.656389:0:12227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782727455.656392:0:12227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921c7df49600/0x14a47870ee88d09e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727455.656397:0:12227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c7df49600/0x14a47870ee88d09e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727455.656436:0:12227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c7df49e00/0x14a47870ee88d090 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf1d8 expref: 14 pid: 12227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727455.656452:0:12227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7df48400/0x14a47870ee88d0a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf1d8 expref: 13 pid: 12227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727455.656458:0:12227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0x0 (ffff921c56fbb700) 00010000:00010000:2.0:1782727455.656461:0:12227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782727455.656469:0:12227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c7df48400, rc 0) 00000100:00100000:2.0:1782727455.656825:0:12227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e030380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d85bc959-008e-4782-8f39-df709fbb4636+13:12603:x1869324914556160:12345-192.168.202.60@tcp:101:dd.0 Request processed in 1080us (1674us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1782727455.656834:0:12227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 61 00000100:00100000:2.0:1782727455.668208:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1782727455.668383:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914556288 00000100:00100000:1.0:1782727455.668395:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914556288 00000100:00100000:1.0:1782727455.668465:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 62 00000100:00100000:1.0:1782727455.668476:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e2ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d85bc959-008e-4782-8f39-df709fbb4636+13:12603:x1869324914556288:12345-192.168.202.60@tcp:101:dd.0 00010000:00010000:1.0:1782727455.668499:0:5950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727455.668520:0:5950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668400/0x14a47870ee88d0b3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1752a87bbfbdf1df expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.668556:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669e00/0x14a47870ee88d0ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.668570:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669e00/0x14a47870ee88d0ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.668601:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669e00/0x14a47870ee88d0ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.668714:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668400/0x14a47870ee88d0b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf1df expref: 15 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.668733:0:5950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669e00/0x14a47870ee88d0ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf1df expref: 14 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.668742:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0x0 (ffff921c56fbb700) 00010000:00010000:1.0:1782727455.668744:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782727455.668748:0:5950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c76669e00, rc 0) 00000100:00100000:1.0:1782727455.668852:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e2ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d85bc959-008e-4782-8f39-df709fbb4636+14:12603:x1869324914556288:12345-192.168.202.60@tcp:101:dd.0 Request processed in 368us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727455.668860:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 62 00000100:00100000:3.0:1782727455.681546:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1782727455.681681:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914556544 00000100:00100000:1.0:1782727455.681690:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914556544 00000100:00100000:1.0:1782727455.681755:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 63 00000100:00100000:1.0:1782727455.681776:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d85bc959-008e-4782-8f39-df709fbb4636+14:12603:x1869324914556544:12345-192.168.202.60@tcp:36:dd.0 00010000:00010000:1.0:1782727455.681852:0:5949:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782727455.681879:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c7df48400/0x14a47870ee88d0a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf1d8 expref: 14 pid: 12227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.681926:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0x0 (ffff921c56fbb700) 00010000:00010000:1.0:1782727455.681931:0:5949:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782727455.682098:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668400/0x14a47870ee88d0c1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.682126:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668400/0x14a47870ee88d0c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.682135:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668400/0x14a47870ee88d0c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782727455.682186:0:5949:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967332 00000004:00010000:1.0:1782727455.682212:0:5949:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000df920edf reply state 000000002f0ee4dc transno 4294967333 ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668400/0x14a47870ee88d0c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727455.682221:0:5949:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782727455.682323:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d85bc959-008e-4782-8f39-df709fbb4636+16:12603:x1869324914556544:12345-192.168.202.60@tcp:36:dd.0 Request processed in 558us (785us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1782727455.682330:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 63 00000020:00080000:1.0:1782727455.682334:0:5949:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1782727455.684305:0:3429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668400/0x14a47870ee88d0c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.684321:0:3429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668400/0x14a47870ee88d0c1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.684328:0:3429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668400/0x14a47870ee88d0c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.684334:0:3429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c76668400 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1782727455.684339:0:3429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668400/0x14a47870ee88d0c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.684347:0:3429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668400/0x14a47870ee88d0c1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.684380:0:3429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0x0 (ffff921c56fbb700) 00010000:00010000:1.0:1782727455.684382:0:3429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782727455.684387:0:3429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668400/0x14a47870ee88d0c1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.684393:0:3429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668400/0x14a47870ee88d0c1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727455.687531:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1782727455.687851:0:6951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914556672 00000100:00100000:0.0:1782727455.687862:0:6951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914556672 00000100:00100000:0.0:1782727455.687958:0:6951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 27 00000100:00100000:0.0:1782727455.687968:0:6951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d85bc959-008e-4782-8f39-df709fbb4636+5:12603:x1869324914556672:12345-192.168.202.60@tcp:101:dd.0 00010000:00010000:0.0:1782727455.687986:0:6951:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727455.688006:0:6951:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004074b9d2/0x14a47870ee88d0c8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1752a87bbfbdf1e6 expref: -99 pid: 6951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782727455.688032:0:6951:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782727455.688063:0:6951:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=350s v=(0 0) 00010000:00010000:0.0:1782727455.688068:0:6951:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782727455.688076:0:6951:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004074b9d2/0x14a47870ee88d0c8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf1e6 expref: 6 pid: 6951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727455.688094:0:6951:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004074b9d2/0x14a47870ee88d0c8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf1e6 expref: 6 pid: 6951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727455.688107:0:6951:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c7a3e1000, rc 0) 00000100:00100000:0.0:1782727455.688182:0:6951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d85bc959-008e-4782-8f39-df709fbb4636+6:12603:x1869324914556672:12345-192.168.202.60@tcp:101:dd.0 Request processed in 214us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727455.688189:0:6951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 27 00000100:00100000:3.0:1782727455.698010:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1782727455.698097:0:9464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914556800 00000100:00100000:1.0:1782727455.698108:0:9464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914556800 00000100:00100000:1.0:1782727455.698167:0:9464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 28 00000100:00100000:1.0:1782727455.698177:0:9464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d85bc959-008e-4782-8f39-df709fbb4636+6:12603:x1869324914556800:12345-192.168.202.60@tcp:101:dd.0 00010000:00010000:1.0:1782727455.698195:0:9464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727455.698217:0:9464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000de1fa9f4/0x14a47870ee88d0cf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1752a87bbfbdf1ed expref: -99 pid: 9464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782727455.698245:0:9464:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1782727455.698279:0:9464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=350s v=(0 0) 00010000:00010000:1.0:1782727455.698284:0:9464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782727455.698294:0:9464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de1fa9f4/0x14a47870ee88d0cf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf1ed expref: 7 pid: 9464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.698317:0:9464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000de1fa9f4/0x14a47870ee88d0cf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf1ed expref: 7 pid: 9464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.698330:0:9464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c76668400, rc 0) 00000100:00100000:1.0:1782727455.698395:0:9464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d85bc959-008e-4782-8f39-df709fbb4636+7:12603:x1869324914556800:12345-192.168.202.60@tcp:101:dd.0 Request processed in 219us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727455.698417:0:9464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 28 00000100:00100000:2.0:1782727455.705460:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1782727455.705496:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1782727455.705624:0:6954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914556928 00000100:00100000:3.0:1782727455.705634:0:6954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914556928 00002000:00010000:3.0:1782727455.705668:0:6954:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:3.0:1782727455.705672:0:6954:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff921c7e2af480 with x1869324914556928 ext(0->18446744073709551615) 00002000:00010000:3.0:1782727455.705683:0:6954:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff921c7e2af480. 00000100:00100000:3.0:1782727455.705713:0:6954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914557056 00000100:00100000:3.0:1782727455.705715:0:6954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914557056 00002000:00010000:3.0:1782727455.705726:0:6954:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:3.0:1782727455.705729:0:6954:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff921c7e2ae680 with x1869324914557056 ext(0->18446744073709551615) 00002000:00010000:3.0:1782727455.705735:0:6954:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff921c7e2ae680. 00000100:00100000:3.0:1782727455.705745:0:6954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 6 00000100:00100000:3.0:1782727455.705753:0:6954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e2af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d85bc959-008e-4782-8f39-df709fbb4636+6:2358:x1869324914556928:12345-192.168.202.60@tcp:10:dd.0 00002000:00010000:3.0:1782727455.705972:0:6954:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1782727455.705992:0:6954:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1782727454 00002000:00010000:3.0:1782727455.705994:0:6954:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1782727455.705997:0:6954:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1782727454 00002000:00010000:3.0:1782727455.705999:0:6954:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1782727455.706074:0:6954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e2af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d85bc959-008e-4782-8f39-df709fbb4636+7:2358:x1869324914556928:12345-192.168.202.60@tcp:10:dd.0 Request processed in 321us (622us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1782727455.706083:0:6954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 6 00002000:00010000:3.0:1782727455.706087:0:6954:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:3.0:1782727455.706090:0:6954:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff921c7e2af480 with x1869324914556928 ext(0->18446744073709551615) 00002000:00010000:3.0:1782727455.706094:0:6954:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff921c7e2af480. 00000100:00100000:3.0:1782727455.706119:0:6954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 7 00000100:00100000:3.0:1782727455.706127:0:6954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e2ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d85bc959-008e-4782-8f39-df709fbb4636+7:2357:x1869324914557056:12345-192.168.202.60@tcp:10:dd.0 00002000:00010000:3.0:1782727455.706215:0:6954:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1782727455.706218:0:6954:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1782727454 00002000:00010000:3.0:1782727455.706220:0:6954:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1782727455.706222:0:6954:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1782727454 00002000:00010000:3.0:1782727455.706224:0:6954:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1782727455.706246:0:6954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e2ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d85bc959-008e-4782-8f39-df709fbb4636+8:2357:x1869324914557056:12345-192.168.202.60@tcp:10:dd.0 Request processed in 120us (748us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1782727455.706252:0:6954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 7 00002000:00010000:3.0:1782727455.706255:0:6954:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:3.0:1782727455.706257:0:6954:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff921c7e2ae680 with x1869324914557056 ext(0->18446744073709551615) 00002000:00010000:3.0:1782727455.706262:0:6954:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff921c7e2ae680. 00000100:00100000:0.0:1782727455.746697:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1782727455.747177:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914557312 00000100:00100000:1.0:1782727455.747188:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914557312 00000100:00100000:1.0:1782727455.747308:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 14 00000100:00100000:1.0:1782727455.747319:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dfc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d85bc959-008e-4782-8f39-df709fbb4636+15:12603:x1869324914557312:12345-192.168.202.60@tcp:35:dd.0 00000100:00100000:1.0:1782727455.747625:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dfc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d85bc959-008e-4782-8f39-df709fbb4636+16:12603:x1869324914557312:12345-192.168.202.60@tcp:35:dd.0 Request processed in 306us (937us total) trans 4294967334 rc 0/0 00000100:00100000:1.0:1782727455.747632:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 14 00000100:00100000:0.0:1782727455.784857:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1782727455.785751:0:6956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914557440 00000100:00100000:2.0:1782727455.785762:0:6956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914557440 00002000:00100000:2.0:1782727455.785828:0:6956:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->131071) req@ffff921c7dfc0700 x1869324914557440/t0(0) o4->d85bc959-008e-4782-8f39-df709fbb4636@192.168.202.60@tcp:326/0 lens 488/0 e 0 to 0 dl 1782727466 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782727455.785847:0:6956:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff921c7dfc0700 with x1869324914557440 ext(0->131071) 00002000:00010000:2.0:1782727455.785853:0:6956:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff921c7dfc0700 00000100:00100000:2.0:1782727455.785930:0:6956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 8 00000100:00100000:2.0:1782727455.785941:0:6956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dfc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d85bc959-008e-4782-8f39-df709fbb4636+7:2356:x1869324914557440:12345-192.168.202.60@tcp:4:dd.0 00000100:00100000:3.0:1782727455.812222:0:6956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dfc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d85bc959-008e-4782-8f39-df709fbb4636+9:2356:x1869324914557440:12345-192.168.202.60@tcp:4:dd.0 Request processed in 26269us (27371us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1782727455.812238:0:6956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 8 00002000:00100000:3.0:1782727455.812268:0:6956:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->131071) req@ffff921c7dfc0700 x1869324914557440/t4294967306(0) o4->d85bc959-008e-4782-8f39-df709fbb4636@192.168.202.60@tcp:326/0 lens 488/448 e 0 to 0 dl 1782727466 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782727455.812959:0:6956:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff921c7dfc0700 with x1869324914557440 ext(0->131071) 00002000:00010000:3.0:1782727455.812968:0:6956:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff921c7dfc0700 00000100:00100000:2.0:1782727455.847587:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1782727455.847730:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914557568 00000100:00100000:1.0:1782727455.847741:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914557568 00000100:00100000:1.0:1782727455.847808:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 64 00000100:00100000:1.0:1782727455.847819:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e2ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d85bc959-008e-4782-8f39-df709fbb4636+16:12605:x1869324914557568:12345-192.168.202.60@tcp:101:rm.0 00010000:00010000:1.0:1782727455.847872:0:5950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727455.848192:0:5950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669200/0x14a47870ee88d0d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1752a87bbfbdf1f4 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.848257:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669c00/0x14a47870ee88d0dd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.848271:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669c00/0x14a47870ee88d0dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.848290:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669c00/0x14a47870ee88d0dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782727455.848332:0:5950:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1782727455.848335:0:5950:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782727455.848352:0:5950:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669c00/0x14a47870ee88d0dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.848386:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669200/0x14a47870ee88d0d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf1f4 expref: 18 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.848404:0:5950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669c00/0x14a47870ee88d0dd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf1f4 expref: 17 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.848413:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921c5fda7100) 00010000:00010000:1.0:1782727455.848416:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782727455.848419:0:5950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c76669c00, rc 0) 00000100:00100000:1.0:1782727455.848469:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e2ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d85bc959-008e-4782-8f39-df709fbb4636+17:12605:x1869324914557568:12345-192.168.202.60@tcp:101:rm.0 Request processed in 653us (891us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727455.848476:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 64 00000100:00100000:0.0:1782727455.864689:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1782727455.864786:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914557696 00000100:00100000:1.0:1782727455.864796:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914557696 00000100:00100000:1.0:1782727455.864864:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 65 00000100:00100000:1.0:1782727455.864914:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dfc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d85bc959-008e-4782-8f39-df709fbb4636+17:12605:x1869324914557696:12345-192.168.202.60@tcp:101:rm.0 00010000:00010000:1.0:1782727455.864935:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727455.864954:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669200/0x14a47870ee88d0e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1752a87bbfbdf1fb expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.865018:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668c00/0x14a47870ee88d0eb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.865032:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668c00/0x14a47870ee88d0eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.865042:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668c00/0x14a47870ee88d0eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.865071:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668e00/0x14a47870ee88d0f2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.865079:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668e00/0x14a47870ee88d0f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.865085:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668e00/0x14a47870ee88d0f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.865167:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669600/0x14a47870ee88d0f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.865176:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669600/0x14a47870ee88d0f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.865183:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669600/0x14a47870ee88d0f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782727455.865226:0:5949:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x8:0x0]: returning size 131072 00000004:00200000:1.0:1782727455.865231:0:5949:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782727455.865249:0:5949:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669600/0x14a47870ee88d0f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.865260:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669600/0x14a47870ee88d0f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.865268:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668c00/0x14a47870ee88d0eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.865275:0:5949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668c00/0x14a47870ee88d0eb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.865292:0:5949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668c00/0x14a47870ee88d0eb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.865297:0:5949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c76668c00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1782727455.865302:0:5949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668c00/0x14a47870ee88d0eb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.865309:0:5949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668c00/0x14a47870ee88d0eb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.865321:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921c5fda7100) 00010000:00010000:1.0:1782727455.865324:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782727455.865328:0:5949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668c00/0x14a47870ee88d0eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.865335:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668c00/0x14a47870ee88d0eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.865349:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668e00/0x14a47870ee88d0f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.865354:0:5949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668e00/0x14a47870ee88d0f2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.865358:0:5949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668e00/0x14a47870ee88d0f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.865362:0:5949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c76668e00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1782727455.865365:0:5949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668e00/0x14a47870ee88d0f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.865378:0:5949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668e00/0x14a47870ee88d0f2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.865386:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe701ffcf (ffff921c5fda7900) 00010000:00010000:1.0:1782727455.865387:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782727455.865390:0:5949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668e00/0x14a47870ee88d0f2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.865395:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668e00/0x14a47870ee88d0f2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.865423:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669200/0x14a47870ee88d0e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf1fb expref: 19 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.865436:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669600/0x14a47870ee88d0f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf1fb expref: 18 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.865443:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0x0 (ffff921c56fbb700) 00010000:00010000:1.0:1782727455.865445:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782727455.865447:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c76669600, rc 0) 00000100:00100000:1.0:1782727455.865494:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dfc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d85bc959-008e-4782-8f39-df709fbb4636+18:12605:x1869324914557696:12345-192.168.202.60@tcp:101:rm.0 Request processed in 622us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727455.865500:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 65 00000100:00100000:3.0:1782727455.885270:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1782727455.885431:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914557952 00000100:00100000:1.0:1782727455.885440:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914557952 00000100:00100000:1.0:1782727455.885519:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 66 00000100:00100000:1.0:1782727455.885531:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d85bc959-008e-4782-8f39-df709fbb4636+18:12605:x1869324914557952:12345-192.168.202.60@tcp:36:rm.0 00010000:00010000:1.0:1782727455.885595:0:5948:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1782727455.885635:0:5948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669600/0x14a47870ee88d0f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf1fb expref: 18 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.885656:0:5948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669e00/0x14a47870ee88d0ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf1df expref: 17 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.885668:0:5948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c7df48e00/0x14a47870ee88d07b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf1ca expref: 16 pid: 12227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.885678:0:5948:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0x0 (ffff921c56fbb700) 00010000:00010000:1.0:1782727455.885692:0:5948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669c00/0x14a47870ee88d0dd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf1f4 expref: 15 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.885699:0:5948:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921c5fda7100) 00010000:00010000:1.0:1782727455.885706:0:5948:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782727455.885729:0:5948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669200/0x14a47870ee88d100 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.885741:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669200/0x14a47870ee88d100 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.885749:0:5948:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669200/0x14a47870ee88d100 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.885761:0:5948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668e00/0x14a47870ee88d107 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.885767:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668e00/0x14a47870ee88d107 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.885774:0:5948:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668e00/0x14a47870ee88d107 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.885873:0:5948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668c00/0x14a47870ee88d10e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.885934:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668c00/0x14a47870ee88d10e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.885943:0:5948:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668c00/0x14a47870ee88d10e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782727455.886159:0:5948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:1.0:1782727455.886167:0:5948:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 350644283418ns, next at 351644281372ns, rc = 0 00000040:00080000:1.0:1782727455.886185:0:5948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:1.0:1782727455.886191:0:5948:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 350644307106ns, next at 351644305056ns, rc = 0 00010000:00010000:1.0:1782727455.886231:0:5948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669400/0x14a47870ee88d115 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.886240:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669400/0x14a47870ee88d115 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.886246:0:5948:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669400/0x14a47870ee88d115 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.886253:0:5948:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669400/0x14a47870ee88d115 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.886259:0:5948:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669400/0x14a47870ee88d115 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.886264:0:5948:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669400/0x14a47870ee88d115 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.886299:0:5948:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782727455.886319:0:5948:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668c00/0x14a47870ee88d10e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.886325:0:5948:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668c00/0x14a47870ee88d10e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.886331:0:5948:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668c00/0x14a47870ee88d10e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.886338:0:5948:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c76668c00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1782727455.886341:0:5948:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668c00/0x14a47870ee88d10e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.886348:0:5948:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668c00/0x14a47870ee88d10e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.886356:0:5948:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0x0 (ffff921c5fda7f00) 00010000:00010000:1.0:1782727455.886358:0:5948:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1782727455.886362:0:5948:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668c00/0x14a47870ee88d10e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.886367:0:5948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668c00/0x14a47870ee88d10e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.886383:0:5948:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669200/0x14a47870ee88d100 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.886389:0:5948:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669200/0x14a47870ee88d100 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.886394:0:5948:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669200/0x14a47870ee88d100 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.886405:0:5948:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c76669200 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1782727455.886408:0:5948:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669200/0x14a47870ee88d100 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.886414:0:5948:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669200/0x14a47870ee88d100 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.886421:0:5948:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921c5fda7900) 00010000:00010000:1.0:1782727455.886423:0:5948:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782727455.886426:0:5948:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669200/0x14a47870ee88d100 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727455.886431:0:5948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669200/0x14a47870ee88d100 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782727455.886446:0:5948:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000067c32f90 reply state 00000000a2788ce7 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668e00/0x14a47870ee88d107 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727455.886454:0:5948:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782727455.886525:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d85bc959-008e-4782-8f39-df709fbb4636+16:12605:x1869324914557952:12345-192.168.202.60@tcp:36:rm.0 Request processed in 996us (1264us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1782727455.886534:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 66 00010000:00010000:2.0:1782727455.886781:0:5937:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782727455.886788:0:5937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669400/0x14a47870ee88d115 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727455.886795:0:5937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c76669400 already unused, calling callback (ffffffffc0c98cf0) 00010000:00010000:2.0:1782727455.886798:0:5937:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669400/0x14a47870ee88d115 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727455.886804:0:5937:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669400/0x14a47870ee88d115 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727455.886814:0:5937:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0x0 (ffff921c5fda7f00) 00010000:00010000:2.0:1782727455.886822:0:5937:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1782727455.886826:0:5937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669400/0x14a47870ee88d115 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727455.886831:0:5937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c76669400/0x14a47870ee88d115 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727455.886858:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727455.886861:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727455.886862:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727455.893178:0:3428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668e00/0x14a47870ee88d107 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727455.893195:0:3428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668e00/0x14a47870ee88d107 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727455.893202:0:3428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668e00/0x14a47870ee88d107 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727455.893209:0:3428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c76668e00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:0.0:1782727455.893214:0:3428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668e00/0x14a47870ee88d107 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727455.893222:0:3428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668e00/0x14a47870ee88d107 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727455.893238:0:3428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe701ffcf (ffff921c5fda7000) 00010000:00010000:0.0:1782727455.893242:0:3428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782727455.893246:0:3428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668e00/0x14a47870ee88d107 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727455.893253:0:3428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c76668e00/0x14a47870ee88d107 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727456.249306:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727457.278510:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727457.318148:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1782727457.318393:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914558080 00000100:00100000:0.0:1782727457.318411:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914558080 00000100:00100000:0.0:1782727457.318479:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 67 00000100:00100000:0.0:1782727457.318490:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e08f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d85bc959-008e-4782-8f39-df709fbb4636+15:12648:x1869324914558080:12345-192.168.202.60@tcp:101:multiop.0 00010000:00010000:0.0:1782727457.318517:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727457.318543:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0e00/0x14a47870ee88d11c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1752a87bbfbdf202 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727457.318623:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1a00/0x14a47870ee88d123 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727457.318638:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1a00/0x14a47870ee88d123 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727457.318649:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1a00/0x14a47870ee88d123 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1782727457.318664:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:0.0:1782727457.318696:0:5949:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1782727457.318700:0:5949:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782727457.318719:0:5949:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1a00/0x14a47870ee88d123 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727457.318743:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e0e00/0x14a47870ee88d11c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf202 expref: 17 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727457.318759:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1a00/0x14a47870ee88d123 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf202 expref: 16 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727457.318768:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921c58b4c300) 00010000:00010000:0.0:1782727457.318771:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782727457.318774:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c7a3e1a00, rc 0) 00000100:00100000:0.0:1782727457.318858:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e08f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d85bc959-008e-4782-8f39-df709fbb4636+16:12648:x1869324914558080:12345-192.168.202.60@tcp:101:multiop.0 Request processed in 369us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727457.318865:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 67 00000100:00100000:2.0:1782727457.335213:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1782727457.335439:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914558336 00000100:00100000:3.0:1782727457.335451:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914558336 00000100:00100000:3.0:1782727457.335521:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 68 00000100:00100000:3.0:1782727457.335531:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e2adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d85bc959-008e-4782-8f39-df709fbb4636+16:12648:x1869324914558336:12345-192.168.202.60@tcp:101:multiop.0 00010000:00010000:3.0:1782727457.335556:0:5948:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727457.335559:0:5948:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1782727457.335586:0:5948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c7a3e1a00/0x14a47870ee88d123 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf202 expref: 16 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727457.335605:0:5948:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921c58b4c300) 00010000:00010000:3.0:1782727457.335616:0:5948:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782727457.335632:0:5948:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c40030800/0x14a47870ee88d12a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1752a87bbfbdf209 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727457.335747:0:5948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff921c40030a00/0x14a47870ee88d131 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727457.335760:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c40030a00/0x14a47870ee88d131 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727457.335769:0:5948:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c40030a00/0x14a47870ee88d131 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727457.335792:0:5948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff921c40030400/0x14a47870ee88d138 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x1e182d30 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727457.335800:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c40030400/0x14a47870ee88d138 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1e182d30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727457.335806:0:5948:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c40030400/0x14a47870ee88d138 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1e182d30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782727457.336176:0:5948:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:3.0:1782727457.336346:0:5948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921c40031000/0x14a47870ee88d13f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727457.336356:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921c40031000/0x14a47870ee88d13f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727457.336363:0:5948:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921c40031000/0x14a47870ee88d13f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727457.336396:0:5948:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff921c40030a00/0x14a47870ee88d131 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727457.336403:0:5948:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921c40030a00/0x14a47870ee88d131 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727457.336409:0:5948:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921c40030a00/0x14a47870ee88d131 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727457.336415:0:5948:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c40030a00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1782727457.336419:0:5948:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c40030a00/0x14a47870ee88d131 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727457.336437:0:5948:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c40030a00/0x14a47870ee88d131 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727457.336448:0:5948:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921c5fdb5500) 00010000:00010000:3.0:1782727457.336451:0:5948:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782727457.336455:0:5948:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921c40030a00/0x14a47870ee88d131 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727457.336460:0:5948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c40030a00/0x14a47870ee88d131 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782727457.336472:0:5948:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000485b2444 reply state 0000000039d12f5a transno 4294967336 ns: mdt-lustre-MDT0000_UUID lock: ffff921c40030400/0x14a47870ee88d138 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1e182d30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727457.336480:0:5948:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782727457.336506:0:5948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c40030800/0x14a47870ee88d12a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf209 expref: 18 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727457.336524:0:5948:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921c40031000/0x14a47870ee88d13f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf209 expref: 17 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727457.336530:0:5948:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff921c5fdb5300) 00010000:00010000:3.0:1782727457.336532:0:5948:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782727457.336535:0:5948:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c40031000, rc 0) 00000100:00100000:3.0:1782727457.339206:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e2adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d85bc959-008e-4782-8f39-df709fbb4636+18:12648:x1869324914558336:12345-192.168.202.60@tcp:101:multiop.0 Request processed in 1076us (1405us total) trans 4294967336 rc 0/0 00000100:00100000:3.0:1782727457.339229:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 68 00010000:00010000:1.0:1782727457.345663:0:3429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff921c40030400/0x14a47870ee88d138 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1e182d30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727457.345683:0:3429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921c40030400/0x14a47870ee88d138 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x1e182d30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727457.345712:0:3429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921c40030400/0x14a47870ee88d138 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x1e182d30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727457.345719:0:3429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c40030400 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1782727457.345724:0:3429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c40030400/0x14a47870ee88d138 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x1e182d30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727457.345734:0:3429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921c40030400/0x14a47870ee88d138 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x1e182d30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727457.345753:0:3429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1e182d30 (ffff921c5fdb5200) 00010000:00010000:1.0:1782727457.345757:0:3429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782727457.345761:0:3429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921c40030400/0x14a47870ee88d138 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x1e182d30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727457.345767:0:3429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921c40030400/0x14a47870ee88d138 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x1e182d30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5948 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727457.355403:0:3435:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1782727457.355596:0:6949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914558464 00000100:00100000:1.0:1782727457.355606:0:6949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914558464 00000100:00100000:1.0:1782727457.355674:0:6949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 29 00000100:00100000:1.0:1782727457.355684:0:6949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dfc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d85bc959-008e-4782-8f39-df709fbb4636+9:12648:x1869324914558464:12345-192.168.202.60@tcp:101:multiop.0 00010000:00010000:1.0:1782727457.355703:0:6949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727457.355722:0:6949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007aa6887e/0x14a47870ee88d14d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1752a87bbfbdf210 expref: -99 pid: 6949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782727457.355746:0:6949:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1782727457.355763:0:6949:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=352s v=(0 0) 00010000:00010000:1.0:1782727457.355777:0:6949:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782727457.355786:0:6949:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007aa6887e/0x14a47870ee88d14d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf210 expref: 10 pid: 6949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727457.355803:0:6949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007aa6887e/0x14a47870ee88d14d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf210 expref: 10 pid: 6949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727457.355815:0:6949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921c76669e00, rc 0) 00000100:00100000:1.0:1782727457.355909:0:6949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dfc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d85bc959-008e-4782-8f39-df709fbb4636+10:12648:x1869324914558464:12345-192.168.202.60@tcp:101:multiop.0 Request processed in 199us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727457.355917:0:6949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 29 00000100:00080000:3.0:1782727457.356211:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782727457.373029:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1782727457.373180:0:6955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914558592 00000100:00100000:3.0:1782727457.373204:0:6955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914558592 00002000:00100000:3.0:1782727457.373248:0:6955:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff921c7dfc1180 x1869324914558592/t0(0) o4->d85bc959-008e-4782-8f39-df709fbb4636@192.168.202.60@tcp:328/0 lens 4584/0 e 0 to 0 dl 1782727468 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782727457.373268:0:6955:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff921c7dfc1180 with x1869324914558592 ext(0->4095) 00002000:00010000:3.0:1782727457.373275:0:6955:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff921c7dfc1180 00000100:00100000:3.0:1782727457.373307:0:6955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 9 00000100:00100000:3.0:1782727457.373318:0:6955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dfc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d85bc959-008e-4782-8f39-df709fbb4636+10:2357:x1869324914558592:12345-192.168.202.60@tcp:4:multiop.0 00000001:00020000:3.0:1782727457.373331:0:6955:0:(tgt_handler.c:2784:tgt_brw_write()) cfs_fail_timeout id 214 sleeping for 5000ms 00010000:00010000:2.0:1782727458.298357:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727459.321224:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727459.514875:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7dfc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c71e9f0f-6441-4b9b-bc96-153ab9250801:3442:1869324939753728:0@lo:400:kworker.0 00000100:00100000:0.0:1782727459.514990:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727459.515046:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7dfc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3442:1869324939754240:0@lo:400:kworker.0 00000100:00100000:0.0:1782727459.515078:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727459.515103:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1782727459.515109:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7dfc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3442:1869324939753856:0@lo:400:kworker.0 00000100:00100000:0.0:1782727459.515130:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727459.515146:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7dfc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869324939754368:0@lo:400:kworker.0 00000100:00100000:0.0:1782727459.515171:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727459.515203:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7dfc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869324939754112:0@lo:400:kworker.0 00000100:00100000:0.0:1782727459.515226:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727459.515248:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782727459.515253:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7dfc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3445:1869324939753984:0@lo:400:kworker.0 00000100:00100000:0.0:1782727459.515273:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727459.515302:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939753728 00000100:00100000:0.0:1782727459.515310:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939753728 00000100:00100000:0.0:1782727459.515353:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1782727459.515362:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fe4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:3442:x1869324939753728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727459.515412:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fe4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c71e9f0f-6441-4b9b-bc96-153ab9250801+19:3442:x1869324939753728:12345-0@lo:400:kworker.0 Request processed in 51us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727459.515420:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1782727459.515471:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939754240 00000100:00100000:0.0:1782727459.515476:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939754240 00000100:00100000:0.0:1782727459.515508:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939753856 00000100:00100000:0.0:1782727459.515510:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939753856 00000100:00100000:0.0:1782727459.515523:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939753984 00000100:00100000:0.0:1782727459.515524:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939753984 00000100:00100000:0.0:1782727459.515539:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1782727459.515545:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c45e42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1869324939754240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727459.515580:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c45e42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1869324939754240:12345-0@lo:400:kworker.0 Request processed in 35us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727459.515586:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1782727459.515598:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1782727459.515604:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c45e40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1869324939753856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727459.515628:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c45e40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1869324939753856:12345-0@lo:400:kworker.0 Request processed in 24us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727459.515634:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1782727459.515644:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1782727459.515649:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c45e41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3445:x1869324939753984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727459.515679:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c45e41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3445:x1869324939753984:12345-0@lo:400:kworker.0 Request processed in 30us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727459.515684:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1782727459.515705:0:9464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939754368 00000100:00100000:0.0:1782727459.515709:0:9464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939754368 00000100:00100000:0.0:1782727459.515731:0:9464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939754112 00000100:00100000:0.0:1782727459.515733:0:9464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939754112 00000100:00100000:0.0:1782727459.515752:0:9464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1782727459.515758:0:9464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c45e41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3442:x1869324939754368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727459.515787:0:9464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c45e41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3442:x1869324939754368:12345-0@lo:400:kworker.0 Request processed in 29us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727459.515799:0:9464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1782727459.515823:0:9464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1782727459.515829:0:9464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c45e42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3445:x1869324939754112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727459.515857:0:9464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c45e42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3445:x1869324939754112:12345-0@lo:400:kworker.0 Request processed in 29us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727459.515863:0:9464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1782727459.515936:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7dfc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3445:1869324939753984:0@lo:400:kworker.0 00000100:00100000:0.0:1782727459.515947:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7dfc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3445:1869324939754112:0@lo:400:kworker.0 00000100:00100000:0.0:1782727459.515976:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7dfc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3442:1869324939753856:0@lo:400:kworker.0 00000100:00100000:0.0:1782727459.515985:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7dfc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869324939754368:0@lo:400:kworker.0 00000100:00100000:0.0:1782727459.515994:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7dfc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c71e9f0f-6441-4b9b-bc96-153ab9250801:3442:1869324939753728:0@lo:400:kworker.0 00000100:00100000:0.0:1782727459.516003:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7dfc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3442:1869324939754240:0@lo:400:kworker.0 00000004:00080000:3.0:1782727459.516580:0:8459:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 354274695518ns, next at 355274693169ns, rc = 0 00000100:00100000:3.0:1782727459.516613:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e0e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869324939754496:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782727459.516646:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1782727459.516686:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782727459.516690:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782727459.516693:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782727459.516983:0:6952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939754496 00000100:00100000:3.0:1782727459.516990:0:6952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939754496 00000100:00100000:3.0:1782727459.517027:0:6952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1782727459.517033:0:6952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324939754496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782727459.517060:0:6952:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1782727459.517099:0:6952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869324939754496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727459.517106:0:6952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1782727459.517162:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e0e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869324939754496:0@lo:13:osp-pre-1-0.0 00000004:00080000:3.0:1782727459.518552:0:7421:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 354276666751ns, next at 355276664944ns, rc = 0 00000100:00100000:3.0:1782727459.518581:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782727459.518606:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e0e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869324939754624:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782727459.518652:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727459.518684:0:6952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939754624 00000100:00100000:3.0:1782727459.518689:0:6952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939754624 00000100:00100000:3.0:1782727459.518723:0:6952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1782727459.518731:0:6952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e0e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3444:x1869324939754624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782727459.518754:0:6952:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33845824 pending 155648 free 3923537920 avail 3692015616 00000100:00100000:3.0:1782727459.518788:0:6952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e0e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3444:x1869324939754624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727459.518795:0:6952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1782727459.518848:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e0e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3444:1869324939754624:0@lo:13:osp-pre-0-0.0 00000004:00080000:1.0:1782727459.520425:0:5929:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000001:00080000:1.0:1782727459.520455:0:5929:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967336 is committed 00000004:00080000:1.0:1782727459.520466:0:5929:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:1.0:1782727459.520468:0:5929:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000004:00080000:1.0:1782727459.520492:0:5929:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000100:00100000:1.0:1782727459.520574:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782727459.520593:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e08df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869324939754752:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782727459.520652:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727459.520696:0:9464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939754752 00000100:00100000:1.0:1782727459.520703:0:9464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939754752 00000100:00100000:1.0:1782727459.520744:0:9464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1782727459.520753:0:9464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7e08ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3443:x1869324939754752:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1782727459.520777:0:9464:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:1.0:1782727459.520802:0:9464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e439aa53/0x14a47870ee88d154 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727459.520833:0:9464:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004074b9d2/0x14a47870ee88d0c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf1e6 expref: 10 pid: 6951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727459.520854:0:9464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=4s v=(0 0) 00010000:00010000:1.0:1782727459.520858:0:9464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782727459.520863:0:9464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e439aa53/0x14a47870ee88d154 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727459.520920:0:9464:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004074b9d2/0x14a47870ee88d0c8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf1e6 expref: 10 pid: 6951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727459.520934:0:9464:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004074b9d2/0x14a47870ee88d0c8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf1e6 expref: 10 pid: 6951 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727459.520946:0:9464:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e08f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9464:1869324939754880:192.168.202.60@tcp:104: 00000100:00100000:1.0:1782727459.521005:0:9464:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c7d924d80 going to sleep for 11 seconds 00000100:00100000:3.0:1782727459.521555:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782727459.521567:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7e0e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869324939755008:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1782727459.521601:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727459.521629:0:6951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324939755008 00000100:00100000:3.0:1782727459.521634:0:6951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324939755008 00000100:00100000:3.0:1782727459.521663:0:6951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1782727459.521670:0:6951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7df21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3442:x1869324939755008:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1782727459.521687:0:6951:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:3.0:1782727459.521703:0:6951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd210a6b/0x14a47870ee88d15b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727459.521718:0:6951:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000de1fa9f4/0x14a47870ee88d0cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf1ed expref: 7 pid: 9464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727459.521726:0:6951:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=4s v=(0 0) 00010000:00010000:3.0:1782727459.521729:0:6951:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782727459.521743:0:6951:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd210a6b/0x14a47870ee88d15b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727459.521766:0:6951:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000de1fa9f4/0x14a47870ee88d0cf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf1ed expref: 7 pid: 9464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727459.521777:0:6951:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000de1fa9f4/0x14a47870ee88d0cf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf1ed expref: 7 pid: 9464 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727459.521788:0:6951:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff921c7df23b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6951:1869324939755136:192.168.202.60@tcp:104: 00000100:00100000:3.0:1782727459.521840:0:6951:0:(client.c:2701:ptlrpc_set_wait()) set ffff921c7d6c0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1782727459.541628:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1782727459.541663:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1782727459.541691:0:5936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914558720 00000100:00100000:0.0:1782727459.541702:0:5936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914558720 00010000:00010000:0.0:1782727459.541758:0:5936:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004074b9d2/0x14a47870ee88d0c8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf1e6 expref: 11 pid: 6951 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727459.541787:0:5936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914558848 00000100:00100000:0.0:1782727459.541791:0:5936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914558848 00010000:00010000:0.0:1782727459.541806:0:5936:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000de1fa9f4/0x14a47870ee88d0cf lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf1ed expref: 8 pid: 9464 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727459.541852:0:5936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 35 00000100:00100000:0.0:1782727459.541862:0:5936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dfc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d85bc959-008e-4782-8f39-df709fbb4636+11:2355:x1869324914558720:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782727459.541878:0:5936:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782727459.541914:0:5936:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004074b9d2/0x14a47870ee88d0c8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf1e6 expref: 11 pid: 6951 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727459.541926:0:5936:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004074b9d2/0x14a47870ee88d0c8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf1e6 expref: 11 pid: 6951 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727459.541951:0:5936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782727459.541954:0:5936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782727459.541960:0:5936:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e439aa53/0x14a47870ee88d154 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 9464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727459.541969:0:5936:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e439aa53/0x14a47870ee88d154 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 9464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727459.541993:0:5936:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782727459.542047:0:5936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dfc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d85bc959-008e-4782-8f39-df709fbb4636+11:2355:x1869324914558720:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 186us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727459.542055:0:5936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 35 00000100:00100000:0.0:1782727459.542073:0:5936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 36 00000100:00100000:0.0:1782727459.542080:0:5936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dfc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d85bc959-008e-4782-8f39-df709fbb4636+8:2355:x1869324914558848:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782727459.542088:0:5936:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782727459.542100:0:5936:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000de1fa9f4/0x14a47870ee88d0cf lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf1ed expref: 8 pid: 9464 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727459.542110:0:5936:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000de1fa9f4/0x14a47870ee88d0cf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf1ed expref: 8 pid: 9464 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727459.542124:0:5936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782727459.542127:0:5936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782727459.542132:0:5936:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd210a6b/0x14a47870ee88d15b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727459.542140:0:5936:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd210a6b/0x14a47870ee88d15b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727459.542153:0:5936:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782727459.542173:0:5936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dfc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d85bc959-008e-4782-8f39-df709fbb4636+8:2355:x1869324914558848:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 93us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727459.542180:0:5936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 36 00000100:00080000:0.0:1782727459.542201:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782727459.542204:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782727459.543051:0:6951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de1fa9f4/0x14a47870ee88d0cf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf1ed expref: 7 pid: 9464 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727459.543072:0:6951:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7df23b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6951:1869324939755136:192.168.202.60@tcp:104: 00010000:00010000:3.0:1782727459.543096:0:6951:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000dd210a6b/0x14a47870ee88d15b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727459.543106:0:6951:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000dd210a6b/0x14a47870ee88d15b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727459.543114:0:6951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd210a6b/0x14a47870ee88d15b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727459.543124:0:6951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd210a6b/0x14a47870ee88d15b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727459.543150:0:6951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd210a6b/0x14a47870ee88d15b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727459.543175:0:6951:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1782727459.543346:0:6951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7df21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3442:x1869324939755008:12345-0@lo:6:osp-syn-1-0.0 Request processed in 21674us (21742us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1782727459.543354:0:6951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:1.0:1782727459.543390:0:9464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004074b9d2/0x14a47870ee88d0c8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.60@tcp remote: 0x1752a87bbfbdf1e6 expref: 10 pid: 6951 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782727459.543392:0:3442:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff921c7e0e5c00/2, rc 0, transno 4294967304 00000100:00100000:3.0:1782727459.543398:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e0e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3442:1869324939755008:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782727459.543402:0:9464:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e08f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9464:1869324939754880:192.168.202.60@tcp:104: 00010000:00010000:1.0:1782727459.543413:0:9464:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e439aa53/0x14a47870ee88d154 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727459.543422:0:9464:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e439aa53/0x14a47870ee88d154 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727459.543428:0:9464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e439aa53/0x14a47870ee88d154 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727459.543444:0:9464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e439aa53/0x14a47870ee88d154 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727459.543451:0:9464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e439aa53/0x14a47870ee88d154 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727459.543474:0:9464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1782727459.543482:0:5938:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782727459.543488:0:5938:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd210a6b/0x14a47870ee88d15b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727459.543496:0:5938:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c40030800 already unused, calling callback (ffffffffc0c98cf0) 00010000:00010000:0.0:1782727459.543499:0:5938:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd210a6b/0x14a47870ee88d15b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727459.543520:0:5938:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd210a6b/0x14a47870ee88d15b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727459.543535:0:5938:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd210a6b/0x14a47870ee88d15b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727459.543542:0:5938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd210a6b/0x14a47870ee88d15b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727459.543559:0:5938:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782727459.543562:0:5938:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e439aa53/0x14a47870ee88d154 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727459.543565:0:9464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7e08ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3443:x1869324939754752:12345-0@lo:6:osp-syn-0-0.0 Request processed in 22813us (22912us total) trans 4294967307 rc 0/0 00010000:00010000:0.0:1782727459.543569:0:5938:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921c76668200 already unused, calling callback (ffffffffc0c98cf0) 00000100:00100000:1.0:1782727459.543572:0:9464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:0.0:1782727459.543573:0:5938:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e439aa53/0x14a47870ee88d154 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727459.543580:0:5938:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e439aa53/0x14a47870ee88d154 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727459.543590:0:5938:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e439aa53/0x14a47870ee88d154 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727459.543596:0:5938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e439aa53/0x14a47870ee88d154 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782727459.543602:0:3443:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff921c7e08df80/2, rc 0, transno 4294967307 00000100:00100000:1.0:1782727459.543606:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff921c7e08df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3443:1869324939754752:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1782727459.543620:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727459.543622:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727459.543624:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727459.543656:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1782727459.546581:0:6943:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:3.0:1782727459.546595:0:6943:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000100:00100000:0.0:1782727459.852966:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1782727459.853015:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1782727459.853050:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914558976 00000100:00100000:0.0:1782727459.853061:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914558976 00000100:00100000:0.0:1782727459.853117:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 258 00000100:00100000:0.0:1782727459.853127:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c5fdb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecaf1fda-ff42-4054-9f39-8e142296107b+10:2356:x1869324914558976:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1782727459.853201:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c5fdb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecaf1fda-ff42-4054-9f39-8e142296107b+10:2356:x1869324914558976:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 74us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727459.853210:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 258 00000100:00100000:3.0:1782727459.854623:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869324914559104 00000100:00100000:3.0:1782727459.854635:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869324914559104 00000100:00100000:3.0:1782727459.854774:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 141 00000100:00100000:3.0:1782727459.854783:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921c7dfc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d85bc959-008e-4782-8f39-df709fbb4636+7:2356:x1869324914559104:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1782727459.854871:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921c7dfc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d85bc959-008e-4782-8f39-df709fbb4636+7:2356:x1869324914559104:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 87us (1915us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727459.854878:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 141 00000100:00080000:0.0:1782727459.860099:0:5945:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:3.0:1782727460.188677:0:12997:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity test_118d: @@@@@@ FAIL: No page in writeback, writeback=0 00010000:00010000:3.0:1782727460.347518:0:8027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1782727461.050858:0:8019:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:1.0:1782727461.050872:0:8019:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00010000:00010000:0.0:1782727461.370116:0:5938:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 12164 lines, 12164 kept, 0 dropped, 0 bad.